Untitled

 avatar
unknown
c_cpp
a month ago
63 kB
1
Indexable
Node Execution Times:
Node: unique_ids_graph_outputs_Identity__10, Execution Time: 0.000006 seconds
Node: bert/encoder/Shape, Execution Time: 0.000005 seconds
Node: bert/encoder/Shape__12, Execution Time: 0.000013 seconds
Node: bert/encoder/strided_slice, Execution Time: 0.000082 seconds
Node: bert/encoder/strided_slice__16, Execution Time: 0.000006 seconds
Node: bert/encoder/strided_slice__17, Execution Time: 0.000007 seconds
Node: bert/encoder/ones/packed_Unsqueeze__18, Execution Time: 0.000014 seconds
Node: bert/encoder/ones/packed_Concat__21, Execution Time: 0.000014 seconds
Node: bert/encoder/ones__22, Execution Time: 0.000006 seconds
Node: bert/encoder/ones, Execution Time: 0.000014 seconds
Node: bert/encoder/Reshape, Execution Time: 0.000008 seconds
Node: bert/encoder/Cast, Execution Time: 0.000006 seconds
Node: bert/encoder/mul, Execution Time: 0.000039 seconds
Node: bert/encoder/layer_9/attention/self/ExpandDims, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_9/attention/self/sub, Execution Time: 0.000018 seconds
Node: bert/encoder/layer_9/attention/self/mul_1, Execution Time: 0.000151 seconds
Node: bert/embeddings/Reshape_2, Execution Time: 0.000008 seconds
Node: bert/embeddings/Reshape, Execution Time: 0.000005 seconds
Node: bert/embeddings/GatherV2, Execution Time: 0.000428 seconds
Node: bert/embeddings/Reshape_1, Execution Time: 0.000007 seconds
Node: bert/embeddings/one_hot, Execution Time: 0.000038 seconds
Node: bert/embeddings/MatMul, Execution Time: 0.263444 seconds
Node: bert/embeddings/Reshape_3, Execution Time: 0.000031 seconds
Node: bert/embeddings/add, Execution Time: 0.000350 seconds
Node: bert/embeddings/add_1, Execution Time: 0.000358 seconds
Node: bert/embeddings/LayerNorm/moments/mean, Execution Time: 0.000095 seconds
Node: bert/embeddings/LayerNorm/moments/SquaredDifference, Execution Time: 0.000312 seconds
Node: bert/embeddings/LayerNorm/moments/SquaredDifference__72, Execution Time: 0.000322 seconds
Node: bert/embeddings/LayerNorm/moments/variance, Execution Time: 0.000055 seconds
Node: bert/embeddings/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds
Node: bert/embeddings/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000010 seconds
Node: bert/embeddings/LayerNorm/batchnorm/Rsqrt__74, Execution Time: 0.000007 seconds
Node: bert/embeddings/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds
Node: bert/embeddings/LayerNorm/batchnorm/mul_2, Execution Time: 0.000005 seconds
Node: bert/embeddings/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds
Node: bert/embeddings/LayerNorm/batchnorm/mul_1, Execution Time: 0.000346 seconds
Node: bert/embeddings/LayerNorm/batchnorm/add_1, Execution Time: 0.000359 seconds
Node: bert/encoder/Reshape_1, Execution Time: 0.000014 seconds
Matmul Fuse Node: bert/encoder/layer_0/attention/self/value/MatMul, Execution Time: 2.923421 seconds
Node: bert/encoder/layer_0/attention/self/Reshape_2, Execution Time: 0.000028 seconds
Node: bert/encoder/layer_0/attention/self/transpose_2, Execution Time: 0.000008 seconds
Matmul Fuse Node: bert/encoder/layer_0/attention/self/query/MatMul, Execution Time: 0.006099 seconds
Node: bert/encoder/layer_0/attention/self/Reshape, Execution Time: 0.000018 seconds
Node: bert/encoder/layer_0/attention/self/transpose, Execution Time: 0.000009 seconds
Matmul Fuse Node: bert/encoder/layer_0/attention/self/key/MatMul, Execution Time: 0.005130 seconds
Node: bert/encoder/layer_0/attention/self/Reshape_1, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_0/attention/self/MatMul__306, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_0/attention/self/MatMul, Execution Time: 0.248202 seconds
Node: bert/encoder/layer_0/attention/self/Mul, Execution Time: 0.005624 seconds
Node: bert/encoder/layer_0/attention/self/add, Execution Time: 0.002322 seconds
Node: bert/encoder/layer_0/attention/self/Softmax, Execution Time: 0.003880 seconds
Node: bert/encoder/layer_0/attention/self/MatMul_1, Execution Time: 0.010044 seconds
Node: bert/encoder/layer_0/attention/self/transpose_3, Execution Time: 0.000019 seconds
Node: bert/encoder/layer_0/attention/self/Reshape_3, Execution Time: 0.000123 seconds
Matmul Fuse Node: bert/encoder/layer_0/attention/output/dense/MatMul, Execution Time: 0.017249 seconds
Node: bert/encoder/layer_0/attention/output/add, Execution Time: 0.000692 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/mean, Execution Time: 0.000100 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000430 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/SquaredDifference__309, Execution Time: 0.000424 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/variance, Execution Time: 0.000069 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/Rsqrt__311, Execution Time: 0.000009 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000447 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000469 seconds
Matmul Fuse Node: bert/encoder/layer_0/intermediate/dense/MatMul, Execution Time: 0.019850 seconds
Node: bert/encoder/layer_0/intermediate/dense/Pow, Execution Time: 0.021974 seconds
Node: bert/encoder/layer_0/intermediate/dense/mul, Execution Time: 0.012573 seconds
Node: bert/encoder/layer_0/intermediate/dense/add, Execution Time: 0.006631 seconds
Node: bert/encoder/layer_0/intermediate/dense/mul_1, Execution Time: 0.005640 seconds
Node: bert/encoder/layer_0/intermediate/dense/Tanh, Execution Time: 0.012317 seconds
Node: bert/encoder/layer_0/intermediate/dense/add_1, Execution Time: 0.006749 seconds
Node: bert/encoder/layer_0/intermediate/dense/mul_2, Execution Time: 0.006286 seconds
Node: bert/encoder/layer_0/intermediate/dense/mul_3, Execution Time: 0.006335 seconds
Matmul Fuse Node: bert/encoder/layer_0/output/dense/MatMul, Execution Time: 0.006904 seconds
Node: bert/encoder/layer_0/output/add, Execution Time: 0.000417 seconds
Node: bert/encoder/layer_0/output/LayerNorm/moments/mean, Execution Time: 0.000075 seconds
Node: bert/encoder/layer_0/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000026 seconds
Node: bert/encoder/layer_0/output/LayerNorm/moments/SquaredDifference__313, Execution Time: 0.000023 seconds
Node: bert/encoder/layer_0/output/LayerNorm/moments/variance, Execution Time: 0.000041 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/Rsqrt__315, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000042 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000047 seconds
Matmul Fuse Node: bert/encoder/layer_1/attention/self/value/MatMul, Execution Time: 0.004738 seconds
Node: bert/encoder/layer_1/attention/self/Reshape_2, Execution Time: 0.000018 seconds
Node: bert/encoder/layer_1/attention/self/transpose_2, Execution Time: 0.000009 seconds
Matmul Fuse Node: bert/encoder/layer_1/attention/self/query/MatMul, Execution Time: 0.004339 seconds
Node: bert/encoder/layer_1/attention/self/Reshape, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_1/attention/self/transpose, Execution Time: 0.000007 seconds
Matmul Fuse Node: bert/encoder/layer_1/attention/self/key/MatMul, Execution Time: 0.005015 seconds
Node: bert/encoder/layer_1/attention/self/Reshape_1, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_1/attention/self/MatMul__320, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_1/attention/self/MatMul, Execution Time: 0.252038 seconds
Node: bert/encoder/layer_1/attention/self/Mul, Execution Time: 0.005617 seconds
Node: bert/encoder/layer_1/attention/self/add, Execution Time: 0.002270 seconds
Node: bert/encoder/layer_1/attention/self/Softmax, Execution Time: 0.002844 seconds
Node: bert/encoder/layer_1/attention/self/MatMul_1, Execution Time: 0.005414 seconds
Node: bert/encoder/layer_1/attention/self/transpose_3, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_1/attention/self/Reshape_3, Execution Time: 0.000118 seconds
Matmul Fuse Node: bert/encoder/layer_1/attention/output/dense/MatMul, Execution Time: 0.006670 seconds
Node: bert/encoder/layer_1/attention/output/add, Execution Time: 0.000594 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/mean, Execution Time: 0.000085 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000389 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/SquaredDifference__323, Execution Time: 0.000330 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/variance, Execution Time: 0.000057 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/Rsqrt__325, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000009 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000356 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000360 seconds
Matmul Fuse Node: bert/encoder/layer_1/intermediate/dense/MatMul, Execution Time: 0.028470 seconds
Node: bert/encoder/layer_1/intermediate/dense/Pow, Execution Time: 0.021227 seconds
Node: bert/encoder/layer_1/intermediate/dense/mul, Execution Time: 0.012580 seconds
Node: bert/encoder/layer_1/intermediate/dense/add, Execution Time: 0.008196 seconds
Node: bert/encoder/layer_1/intermediate/dense/mul_1, Execution Time: 0.005632 seconds
Node: bert/encoder/layer_1/intermediate/dense/Tanh, Execution Time: 0.012254 seconds
Node: bert/encoder/layer_1/intermediate/dense/add_1, Execution Time: 0.006654 seconds
Node: bert/encoder/layer_1/intermediate/dense/mul_2, Execution Time: 0.006237 seconds
Node: bert/encoder/layer_1/intermediate/dense/mul_3, Execution Time: 0.006218 seconds
Matmul Fuse Node: bert/encoder/layer_1/output/dense/MatMul, Execution Time: 0.006732 seconds
Node: bert/encoder/layer_1/output/add, Execution Time: 0.000446 seconds
Node: bert/encoder/layer_1/output/LayerNorm/moments/mean, Execution Time: 0.000076 seconds
Node: bert/encoder/layer_1/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000031 seconds
Node: bert/encoder/layer_1/output/LayerNorm/moments/SquaredDifference__327, Execution Time: 0.000027 seconds
Node: bert/encoder/layer_1/output/LayerNorm/moments/variance, Execution Time: 0.000041 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/add, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000003 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/Rsqrt__329, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000051 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000053 seconds
Matmul Fuse Node: bert/encoder/layer_2/attention/self/value/MatMul, Execution Time: 0.004555 seconds
Node: bert/encoder/layer_2/attention/self/Reshape_2, Execution Time: 0.000017 seconds
Node: bert/encoder/layer_2/attention/self/transpose_2, Execution Time: 0.000008 seconds
Matmul Fuse Node: bert/encoder/layer_2/attention/self/query/MatMul, Execution Time: 0.004414 seconds
Node: bert/encoder/layer_2/attention/self/Reshape, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_2/attention/self/transpose, Execution Time: 0.000008 seconds
Matmul Fuse Node: bert/encoder/layer_2/attention/self/key/MatMul, Execution Time: 0.004979 seconds
Node: bert/encoder/layer_2/attention/self/Reshape_1, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_2/attention/self/MatMul__334, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_2/attention/self/MatMul, Execution Time: 0.244382 seconds
Node: bert/encoder/layer_2/attention/self/Mul, Execution Time: 0.005622 seconds
Node: bert/encoder/layer_2/attention/self/add, Execution Time: 0.002254 seconds
Node: bert/encoder/layer_2/attention/self/Softmax, Execution Time: 0.003083 seconds
Node: bert/encoder/layer_2/attention/self/MatMul_1, Execution Time: 0.005330 seconds
Node: bert/encoder/layer_2/attention/self/transpose_3, Execution Time: 0.000015 seconds
Node: bert/encoder/layer_2/attention/self/Reshape_3, Execution Time: 0.000120 seconds
Matmul Fuse Node: bert/encoder/layer_2/attention/output/dense/MatMul, Execution Time: 0.007471 seconds
Node: bert/encoder/layer_2/attention/output/add, Execution Time: 0.000603 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/mean, Execution Time: 0.000089 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000046 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/SquaredDifference__337, Execution Time: 0.000350 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/variance, Execution Time: 0.000060 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/Rsqrt__339, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000354 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000359 seconds
Matmul Fuse Node: bert/encoder/layer_2/intermediate/dense/MatMul, Execution Time: 0.009079 seconds
Node: bert/encoder/layer_2/intermediate/dense/Pow, Execution Time: 0.016791 seconds
Node: bert/encoder/layer_2/intermediate/dense/mul, Execution Time: 0.010142 seconds
Node: bert/encoder/layer_2/intermediate/dense/add, Execution Time: 0.009470 seconds
Node: bert/encoder/layer_2/intermediate/dense/mul_1, Execution Time: 0.009278 seconds
Node: bert/encoder/layer_2/intermediate/dense/Tanh, Execution Time: 0.016555 seconds
Node: bert/encoder/layer_2/intermediate/dense/add_1, Execution Time: 0.006574 seconds
Node: bert/encoder/layer_2/intermediate/dense/mul_2, Execution Time: 0.006185 seconds
Node: bert/encoder/layer_2/intermediate/dense/mul_3, Execution Time: 0.006200 seconds
Matmul Fuse Node: bert/encoder/layer_2/output/dense/MatMul, Execution Time: 0.006927 seconds
Node: bert/encoder/layer_2/output/add, Execution Time: 0.000438 seconds
Node: bert/encoder/layer_2/output/LayerNorm/moments/mean, Execution Time: 0.000082 seconds
Node: bert/encoder/layer_2/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000030 seconds
Node: bert/encoder/layer_2/output/LayerNorm/moments/SquaredDifference__341, Execution Time: 0.000025 seconds
Node: bert/encoder/layer_2/output/LayerNorm/moments/variance, Execution Time: 0.000041 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/add, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/Rsqrt__343, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/sub, Execution Time: 0.000003 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000044 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000046 seconds
Matmul Fuse Node: bert/encoder/layer_3/attention/self/value/MatMul, Execution Time: 0.004408 seconds
Node: bert/encoder/layer_3/attention/self/Reshape_2, Execution Time: 0.000017 seconds
Node: bert/encoder/layer_3/attention/self/transpose_2, Execution Time: 0.000009 seconds
Matmul Fuse Node: bert/encoder/layer_3/attention/self/query/MatMul, Execution Time: 0.004378 seconds
Node: bert/encoder/layer_3/attention/self/Reshape, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_3/attention/self/transpose, Execution Time: 0.000007 seconds
Matmul Fuse Node: bert/encoder/layer_3/attention/self/key/MatMul, Execution Time: 0.004264 seconds
Node: bert/encoder/layer_3/attention/self/Reshape_1, Execution Time: 0.000012 seconds
Node: bert/encoder/layer_3/attention/self/MatMul__348, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_3/attention/self/MatMul, Execution Time: 0.244595 seconds
Node: bert/encoder/layer_3/attention/self/Mul, Execution Time: 0.005615 seconds
Node: bert/encoder/layer_3/attention/self/add, Execution Time: 0.002268 seconds
Node: bert/encoder/layer_3/attention/self/Softmax, Execution Time: 0.003315 seconds
Node: bert/encoder/layer_3/attention/self/MatMul_1, Execution Time: 0.009411 seconds
Node: bert/encoder/layer_3/attention/self/transpose_3, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_3/attention/self/Reshape_3, Execution Time: 0.000113 seconds
Matmul Fuse Node: bert/encoder/layer_3/attention/output/dense/MatMul, Execution Time: 0.009412 seconds
Node: bert/encoder/layer_3/attention/output/add, Execution Time: 0.000607 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/mean, Execution Time: 0.000091 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000222 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/SquaredDifference__351, Execution Time: 0.000331 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/variance, Execution Time: 0.000056 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/Rsqrt__353, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000341 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000361 seconds
Matmul Fuse Node: bert/encoder/layer_3/intermediate/dense/MatMul, Execution Time: 0.015664 seconds
Node: bert/encoder/layer_3/intermediate/dense/Pow, Execution Time: 0.016810 seconds
Node: bert/encoder/layer_3/intermediate/dense/mul, Execution Time: 0.010054 seconds
Node: bert/encoder/layer_3/intermediate/dense/add, Execution Time: 0.009544 seconds
Node: bert/encoder/layer_3/intermediate/dense/mul_1, Execution Time: 0.009331 seconds
Node: bert/encoder/layer_3/intermediate/dense/Tanh, Execution Time: 0.013286 seconds
Node: bert/encoder/layer_3/intermediate/dense/add_1, Execution Time: 0.006505 seconds
Node: bert/encoder/layer_3/intermediate/dense/mul_2, Execution Time: 0.006143 seconds
Node: bert/encoder/layer_3/intermediate/dense/mul_3, Execution Time: 0.006172 seconds
Matmul Fuse Node: bert/encoder/layer_3/output/dense/MatMul, Execution Time: 0.006868 seconds
Node: bert/encoder/layer_3/output/add, Execution Time: 0.000450 seconds
Node: bert/encoder/layer_3/output/LayerNorm/moments/mean, Execution Time: 0.000075 seconds
Node: bert/encoder/layer_3/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000031 seconds
Node: bert/encoder/layer_3/output/LayerNorm/moments/SquaredDifference__355, Execution Time: 0.000026 seconds
Node: bert/encoder/layer_3/output/LayerNorm/moments/variance, Execution Time: 0.000040 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/Rsqrt__357, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/sub, Execution Time: 0.000003 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000042 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000055 seconds
Matmul Fuse Node: bert/encoder/layer_4/attention/self/value/MatMul, Execution Time: 0.004518 seconds
Node: bert/encoder/layer_4/attention/self/Reshape_2, Execution Time: 0.000017 seconds
Node: bert/encoder/layer_4/attention/self/transpose_2, Execution Time: 0.000008 seconds
Matmul Fuse Node: bert/encoder/layer_4/attention/self/query/MatMul, Execution Time: 0.004355 seconds
Node: bert/encoder/layer_4/attention/self/Reshape, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_4/attention/self/transpose, Execution Time: 0.000007 seconds
Matmul Fuse Node: bert/encoder/layer_4/attention/self/key/MatMul, Execution Time: 0.004283 seconds
Node: bert/encoder/layer_4/attention/self/Reshape_1, Execution Time: 0.000012 seconds
Node: bert/encoder/layer_4/attention/self/MatMul__362, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_4/attention/self/MatMul, Execution Time: 0.244649 seconds
Node: bert/encoder/layer_4/attention/self/Mul, Execution Time: 0.005620 seconds
Node: bert/encoder/layer_4/attention/self/add, Execution Time: 0.002235 seconds
Node: bert/encoder/layer_4/attention/self/Softmax, Execution Time: 0.002923 seconds
Node: bert/encoder/layer_4/attention/self/MatMul_1, Execution Time: 0.009138 seconds
Node: bert/encoder/layer_4/attention/self/transpose_3, Execution Time: 0.000017 seconds
Node: bert/encoder/layer_4/attention/self/Reshape_3, Execution Time: 0.000118 seconds
Matmul Fuse Node: bert/encoder/layer_4/attention/output/dense/MatMul, Execution Time: 0.008332 seconds
Node: bert/encoder/layer_4/attention/output/add, Execution Time: 0.000610 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/mean, Execution Time: 0.000092 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000041 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/SquaredDifference__365, Execution Time: 0.000201 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/variance, Execution Time: 0.000056 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/Rsqrt__367, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000347 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000363 seconds
Matmul Fuse Node: bert/encoder/layer_4/intermediate/dense/MatMul, Execution Time: 0.014208 seconds
Node: bert/encoder/layer_4/intermediate/dense/Pow, Execution Time: 0.016982 seconds
Node: bert/encoder/layer_4/intermediate/dense/mul, Execution Time: 0.010030 seconds
Node: bert/encoder/layer_4/intermediate/dense/add, Execution Time: 0.009479 seconds
Node: bert/encoder/layer_4/intermediate/dense/mul_1, Execution Time: 0.009355 seconds
Node: bert/encoder/layer_4/intermediate/dense/Tanh, Execution Time: 0.014290 seconds
Node: bert/encoder/layer_4/intermediate/dense/add_1, Execution Time: 0.006647 seconds
Node: bert/encoder/layer_4/intermediate/dense/mul_2, Execution Time: 0.006236 seconds
Node: bert/encoder/layer_4/intermediate/dense/mul_3, Execution Time: 0.006242 seconds
Matmul Fuse Node: bert/encoder/layer_4/output/dense/MatMul, Execution Time: 0.006896 seconds
Node: bert/encoder/layer_4/output/add, Execution Time: 0.000458 seconds
Node: bert/encoder/layer_4/output/LayerNorm/moments/mean, Execution Time: 0.000075 seconds
Node: bert/encoder/layer_4/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000031 seconds
Node: bert/encoder/layer_4/output/LayerNorm/moments/SquaredDifference__369, Execution Time: 0.000025 seconds
Node: bert/encoder/layer_4/output/LayerNorm/moments/variance, Execution Time: 0.000041 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/Rsqrt__371, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000046 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000046 seconds
Matmul Fuse Node: bert/encoder/layer_5/attention/self/value/MatMul, Execution Time: 0.004612 seconds
Node: bert/encoder/layer_5/attention/self/Reshape_2, Execution Time: 0.000016 seconds
Node: bert/encoder/layer_5/attention/self/transpose_2, Execution Time: 0.000009 seconds
Matmul Fuse Node: bert/encoder/layer_5/attention/self/query/MatMul, Execution Time: 0.004437 seconds
Node: bert/encoder/layer_5/attention/self/Reshape, Execution Time: 0.000015 seconds
Node: bert/encoder/layer_5/attention/self/transpose, Execution Time: 0.000007 seconds
Matmul Fuse Node: bert/encoder/layer_5/attention/self/key/MatMul, Execution Time: 0.004299 seconds
Node: bert/encoder/layer_5/attention/self/Reshape_1, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_5/attention/self/MatMul__376, Execution Time: 0.000008 seconds
Node: bert/encoder/layer_5/attention/self/MatMul, Execution Time: 0.244592 seconds
Node: bert/encoder/layer_5/attention/self/Mul, Execution Time: 0.005615 seconds
Node: bert/encoder/layer_5/attention/self/add, Execution Time: 0.002190 seconds
Node: bert/encoder/layer_5/attention/self/Softmax, Execution Time: 0.002858 seconds
Node: bert/encoder/layer_5/attention/self/MatMul_1, Execution Time: 0.004663 seconds
Node: bert/encoder/layer_5/attention/self/transpose_3, Execution Time: 0.000015 seconds
Node: bert/encoder/layer_5/attention/self/Reshape_3, Execution Time: 0.000123 seconds
Matmul Fuse Node: bert/encoder/layer_5/attention/output/dense/MatMul, Execution Time: 0.007522 seconds
Node: bert/encoder/layer_5/attention/output/add, Execution Time: 0.000611 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/mean, Execution Time: 0.000089 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000026 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/SquaredDifference__379, Execution Time: 0.000326 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/variance, Execution Time: 0.000059 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/Rsqrt__381, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000341 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000356 seconds
Matmul Fuse Node: bert/encoder/layer_5/intermediate/dense/MatMul, Execution Time: 0.007535 seconds
Node: bert/encoder/layer_5/intermediate/dense/Pow, Execution Time: 0.016971 seconds
Node: bert/encoder/layer_5/intermediate/dense/mul, Execution Time: 0.010106 seconds
Node: bert/encoder/layer_5/intermediate/dense/add, Execution Time: 0.009492 seconds
Node: bert/encoder/layer_5/intermediate/dense/mul_1, Execution Time: 0.009312 seconds
Node: bert/encoder/layer_5/intermediate/dense/Tanh, Execution Time: 0.017089 seconds
Node: bert/encoder/layer_5/intermediate/dense/add_1, Execution Time: 0.006615 seconds
Node: bert/encoder/layer_5/intermediate/dense/mul_2, Execution Time: 0.006253 seconds
Node: bert/encoder/layer_5/intermediate/dense/mul_3, Execution Time: 0.006204 seconds
Matmul Fuse Node: bert/encoder/layer_5/output/dense/MatMul, Execution Time: 0.007736 seconds
Node: bert/encoder/layer_5/output/add, Execution Time: 0.000471 seconds
Node: bert/encoder/layer_5/output/LayerNorm/moments/mean, Execution Time: 0.000078 seconds
Node: bert/encoder/layer_5/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000037 seconds
Node: bert/encoder/layer_5/output/LayerNorm/moments/SquaredDifference__383, Execution Time: 0.000029 seconds
Node: bert/encoder/layer_5/output/LayerNorm/moments/variance, Execution Time: 0.000041 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/Rsqrt__385, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000053 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000049 seconds
Matmul Fuse Node: bert/encoder/layer_6/attention/self/value/MatMul, Execution Time: 0.005228 seconds
Node: bert/encoder/layer_6/attention/self/Reshape_2, Execution Time: 0.000018 seconds
Node: bert/encoder/layer_6/attention/self/transpose_2, Execution Time: 0.000008 seconds
Matmul Fuse Node: bert/encoder/layer_6/attention/self/query/MatMul, Execution Time: 0.004674 seconds
Node: bert/encoder/layer_6/attention/self/Reshape, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_6/attention/self/transpose, Execution Time: 0.000007 seconds
Matmul Fuse Node: bert/encoder/layer_6/attention/self/key/MatMul, Execution Time: 0.004387 seconds
Node: bert/encoder/layer_6/attention/self/Reshape_1, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_6/attention/self/MatMul__390, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_6/attention/self/MatMul, Execution Time: 0.244419 seconds
Node: bert/encoder/layer_6/attention/self/Mul, Execution Time: 0.005610 seconds
Node: bert/encoder/layer_6/attention/self/add, Execution Time: 0.002240 seconds
Node: bert/encoder/layer_6/attention/self/Softmax, Execution Time: 0.002904 seconds
Node: bert/encoder/layer_6/attention/self/MatMul_1, Execution Time: 0.004638 seconds
Node: bert/encoder/layer_6/attention/self/transpose_3, Execution Time: 0.000015 seconds
Node: bert/encoder/layer_6/attention/self/Reshape_3, Execution Time: 0.000122 seconds
Matmul Fuse Node: bert/encoder/layer_6/attention/output/dense/MatMul, Execution Time: 0.007547 seconds
Node: bert/encoder/layer_6/attention/output/add, Execution Time: 0.000606 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/mean, Execution Time: 0.000085 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000046 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/SquaredDifference__393, Execution Time: 0.000335 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/variance, Execution Time: 0.000057 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/Rsqrt__395, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000345 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000351 seconds
Matmul Fuse Node: bert/encoder/layer_6/intermediate/dense/MatMul, Execution Time: 0.008843 seconds
Node: bert/encoder/layer_6/intermediate/dense/Pow, Execution Time: 0.016976 seconds
Node: bert/encoder/layer_6/intermediate/dense/mul, Execution Time: 0.010055 seconds
Node: bert/encoder/layer_6/intermediate/dense/add, Execution Time: 0.009470 seconds
Node: bert/encoder/layer_6/intermediate/dense/mul_1, Execution Time: 0.009349 seconds
Node: bert/encoder/layer_6/intermediate/dense/Tanh, Execution Time: 0.016520 seconds
Node: bert/encoder/layer_6/intermediate/dense/add_1, Execution Time: 0.006582 seconds
Node: bert/encoder/layer_6/intermediate/dense/mul_2, Execution Time: 0.006221 seconds
Node: bert/encoder/layer_6/intermediate/dense/mul_3, Execution Time: 0.006184 seconds
Matmul Fuse Node: bert/encoder/layer_6/output/dense/MatMul, Execution Time: 0.006756 seconds
Node: bert/encoder/layer_6/output/add, Execution Time: 0.000442 seconds
Node: bert/encoder/layer_6/output/LayerNorm/moments/mean, Execution Time: 0.000077 seconds
Node: bert/encoder/layer_6/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000033 seconds
Node: bert/encoder/layer_6/output/LayerNorm/moments/SquaredDifference__397, Execution Time: 0.000030 seconds
Node: bert/encoder/layer_6/output/LayerNorm/moments/variance, Execution Time: 0.000042 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/Rsqrt__399, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000043 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000044 seconds
Matmul Fuse Node: bert/encoder/layer_7/attention/self/value/MatMul, Execution Time: 0.005215 seconds
Node: bert/encoder/layer_7/attention/self/Reshape_2, Execution Time: 0.000017 seconds
Node: bert/encoder/layer_7/attention/self/transpose_2, Execution Time: 0.000009 seconds
Matmul Fuse Node: bert/encoder/layer_7/attention/self/query/MatMul, Execution Time: 0.004282 seconds
Node: bert/encoder/layer_7/attention/self/Reshape, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_7/attention/self/transpose, Execution Time: 0.000011 seconds
Matmul Fuse Node: bert/encoder/layer_7/attention/self/key/MatMul, Execution Time: 0.004284 seconds
Node: bert/encoder/layer_7/attention/self/Reshape_1, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_7/attention/self/MatMul__404, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_7/attention/self/MatMul, Execution Time: 0.244721 seconds
Node: bert/encoder/layer_7/attention/self/Mul, Execution Time: 0.005610 seconds
Node: bert/encoder/layer_7/attention/self/add, Execution Time: 0.002252 seconds
Node: bert/encoder/layer_7/attention/self/Softmax, Execution Time: 0.002888 seconds
Node: bert/encoder/layer_7/attention/self/MatMul_1, Execution Time: 0.005186 seconds
Node: bert/encoder/layer_7/attention/self/transpose_3, Execution Time: 0.000015 seconds
Node: bert/encoder/layer_7/attention/self/Reshape_3, Execution Time: 0.000122 seconds
Matmul Fuse Node: bert/encoder/layer_7/attention/output/dense/MatMul, Execution Time: 0.008101 seconds
Node: bert/encoder/layer_7/attention/output/add, Execution Time: 0.000598 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/mean, Execution Time: 0.000086 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000207 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/SquaredDifference__407, Execution Time: 0.000324 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/variance, Execution Time: 0.000059 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/Rsqrt__409, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000343 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000369 seconds
Matmul Fuse Node: bert/encoder/layer_7/intermediate/dense/MatMul, Execution Time: 0.015323 seconds
Node: bert/encoder/layer_7/intermediate/dense/Pow, Execution Time: 0.016762 seconds
Node: bert/encoder/layer_7/intermediate/dense/mul, Execution Time: 0.010088 seconds
Node: bert/encoder/layer_7/intermediate/dense/add, Execution Time: 0.009523 seconds
Node: bert/encoder/layer_7/intermediate/dense/mul_1, Execution Time: 0.009305 seconds
Node: bert/encoder/layer_7/intermediate/dense/Tanh, Execution Time: 0.013894 seconds
Node: bert/encoder/layer_7/intermediate/dense/add_1, Execution Time: 0.006436 seconds
Node: bert/encoder/layer_7/intermediate/dense/mul_2, Execution Time: 0.006119 seconds
Node: bert/encoder/layer_7/intermediate/dense/mul_3, Execution Time: 0.006081 seconds
Matmul Fuse Node: bert/encoder/layer_7/output/dense/MatMul, Execution Time: 0.006754 seconds
Node: bert/encoder/layer_7/output/add, Execution Time: 0.000457 seconds
Node: bert/encoder/layer_7/output/LayerNorm/moments/mean, Execution Time: 0.000075 seconds
Node: bert/encoder/layer_7/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000035 seconds
Node: bert/encoder/layer_7/output/LayerNorm/moments/SquaredDifference__411, Execution Time: 0.000024 seconds
Node: bert/encoder/layer_7/output/LayerNorm/moments/variance, Execution Time: 0.000041 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/Rsqrt__413, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000044 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000043 seconds
Matmul Fuse Node: bert/encoder/layer_8/attention/self/value/MatMul, Execution Time: 0.004354 seconds
Node: bert/encoder/layer_8/attention/self/Reshape_2, Execution Time: 0.000018 seconds
Node: bert/encoder/layer_8/attention/self/transpose_2, Execution Time: 0.000008 seconds
Matmul Fuse Node: bert/encoder/layer_8/attention/self/query/MatMul, Execution Time: 0.004952 seconds
Node: bert/encoder/layer_8/attention/self/Reshape, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_8/attention/self/transpose, Execution Time: 0.000007 seconds
Matmul Fuse Node: bert/encoder/layer_8/attention/self/key/MatMul, Execution Time: 0.004135 seconds
Node: bert/encoder/layer_8/attention/self/Reshape_1, Execution Time: 0.000012 seconds
Node: bert/encoder/layer_8/attention/self/MatMul__418, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_8/attention/self/MatMul, Execution Time: 0.243845 seconds
Node: bert/encoder/layer_8/attention/self/Mul, Execution Time: 0.005615 seconds
Node: bert/encoder/layer_8/attention/self/add, Execution Time: 0.002218 seconds
Node: bert/encoder/layer_8/attention/self/Softmax, Execution Time: 0.002845 seconds
Node: bert/encoder/layer_8/attention/self/MatMul_1, Execution Time: 0.004486 seconds
Node: bert/encoder/layer_8/attention/self/transpose_3, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_8/attention/self/Reshape_3, Execution Time: 0.000125 seconds
Matmul Fuse Node: bert/encoder/layer_8/attention/output/dense/MatMul, Execution Time: 0.007337 seconds
Node: bert/encoder/layer_8/attention/output/add, Execution Time: 0.000602 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/mean, Execution Time: 0.000088 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000333 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/SquaredDifference__421, Execution Time: 0.000367 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/variance, Execution Time: 0.000057 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/Rsqrt__423, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000353 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000353 seconds
Matmul Fuse Node: bert/encoder/layer_8/intermediate/dense/MatMul, Execution Time: 0.007715 seconds
Node: bert/encoder/layer_8/intermediate/dense/Pow, Execution Time: 0.016644 seconds
Node: bert/encoder/layer_8/intermediate/dense/mul, Execution Time: 0.010030 seconds
Node: bert/encoder/layer_8/intermediate/dense/add, Execution Time: 0.009488 seconds
Node: bert/encoder/layer_8/intermediate/dense/mul_1, Execution Time: 0.009296 seconds
Node: bert/encoder/layer_8/intermediate/dense/Tanh, Execution Time: 0.016915 seconds
Node: bert/encoder/layer_8/intermediate/dense/add_1, Execution Time: 0.006346 seconds
Node: bert/encoder/layer_8/intermediate/dense/mul_2, Execution Time: 0.006014 seconds
Node: bert/encoder/layer_8/intermediate/dense/mul_3, Execution Time: 0.006008 seconds
Matmul Fuse Node: bert/encoder/layer_8/output/dense/MatMul, Execution Time: 0.006807 seconds
Node: bert/encoder/layer_8/output/add, Execution Time: 0.000453 seconds
Node: bert/encoder/layer_8/output/LayerNorm/moments/mean, Execution Time: 0.000076 seconds
Node: bert/encoder/layer_8/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000029 seconds
Node: bert/encoder/layer_8/output/LayerNorm/moments/SquaredDifference__425, Execution Time: 0.000024 seconds
Node: bert/encoder/layer_8/output/LayerNorm/moments/variance, Execution Time: 0.000041 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/Rsqrt__427, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/sub, Execution Time: 0.000010 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000046 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000043 seconds
Matmul Fuse Node: bert/encoder/layer_9/attention/self/value/MatMul, Execution Time: 0.004432 seconds
Node: bert/encoder/layer_9/attention/self/Reshape_2, Execution Time: 0.000018 seconds
Node: bert/encoder/layer_9/attention/self/transpose_2, Execution Time: 0.000008 seconds
Matmul Fuse Node: bert/encoder/layer_9/attention/self/query/MatMul, Execution Time: 0.004335 seconds
Node: bert/encoder/layer_9/attention/self/Reshape, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_9/attention/self/transpose, Execution Time: 0.000007 seconds
Matmul Fuse Node: bert/encoder/layer_9/attention/self/key/MatMul, Execution Time: 0.004863 seconds
Node: bert/encoder/layer_9/attention/self/Reshape_1, Execution Time: 0.000012 seconds
Node: bert/encoder/layer_9/attention/self/MatMul__432, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_9/attention/self/MatMul, Execution Time: 0.244467 seconds
Node: bert/encoder/layer_9/attention/self/Mul, Execution Time: 0.005625 seconds
Node: bert/encoder/layer_9/attention/self/add, Execution Time: 0.002209 seconds
Node: bert/encoder/layer_9/attention/self/Softmax, Execution Time: 0.003450 seconds
Node: bert/encoder/layer_9/attention/self/MatMul_1, Execution Time: 0.004668 seconds
Node: bert/encoder/layer_9/attention/self/transpose_3, Execution Time: 0.000015 seconds
Node: bert/encoder/layer_9/attention/self/Reshape_3, Execution Time: 0.000119 seconds
Matmul Fuse Node: bert/encoder/layer_9/attention/output/dense/MatMul, Execution Time: 0.007369 seconds
Node: bert/encoder/layer_9/attention/output/add, Execution Time: 0.000593 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/mean, Execution Time: 0.000087 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000219 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/SquaredDifference__435, Execution Time: 0.000331 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/variance, Execution Time: 0.000057 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/Rsqrt__437, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000348 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000354 seconds
Matmul Fuse Node: bert/encoder/layer_9/intermediate/dense/MatMul, Execution Time: 0.007658 seconds
Node: bert/encoder/layer_9/intermediate/dense/Pow, Execution Time: 0.016806 seconds
Node: bert/encoder/layer_9/intermediate/dense/mul, Execution Time: 0.010078 seconds
Node: bert/encoder/layer_9/intermediate/dense/add, Execution Time: 0.009510 seconds
Node: bert/encoder/layer_9/intermediate/dense/mul_1, Execution Time: 0.009300 seconds
Node: bert/encoder/layer_9/intermediate/dense/Tanh, Execution Time: 0.016968 seconds
Node: bert/encoder/layer_9/intermediate/dense/add_1, Execution Time: 0.006485 seconds
Node: bert/encoder/layer_9/intermediate/dense/mul_2, Execution Time: 0.006137 seconds
Node: bert/encoder/layer_9/intermediate/dense/mul_3, Execution Time: 0.006101 seconds
Matmul Fuse Node: bert/encoder/layer_9/output/dense/MatMul, Execution Time: 0.006950 seconds
Node: bert/encoder/layer_9/output/add, Execution Time: 0.000457 seconds
Node: bert/encoder/layer_9/output/LayerNorm/moments/mean, Execution Time: 0.000075 seconds
Node: bert/encoder/layer_9/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000036 seconds
Node: bert/encoder/layer_9/output/LayerNorm/moments/SquaredDifference__439, Execution Time: 0.000025 seconds
Node: bert/encoder/layer_9/output/LayerNorm/moments/variance, Execution Time: 0.000044 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/Rsqrt__441, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000048 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000049 seconds
Matmul Fuse Node: bert/encoder/layer_10/attention/self/value/MatMul, Execution Time: 0.004430 seconds
Node: bert/encoder/layer_10/attention/self/Reshape_2, Execution Time: 0.000018 seconds
Node: bert/encoder/layer_10/attention/self/transpose_2, Execution Time: 0.000008 seconds
Matmul Fuse Node: bert/encoder/layer_10/attention/self/query/MatMul, Execution Time: 0.004482 seconds
Node: bert/encoder/layer_10/attention/self/Reshape, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_10/attention/self/transpose, Execution Time: 0.000008 seconds
Matmul Fuse Node: bert/encoder/layer_10/attention/self/key/MatMul, Execution Time: 0.004213 seconds
Node: bert/encoder/layer_10/attention/self/Reshape_1, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_10/attention/self/MatMul__446, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_10/attention/self/MatMul, Execution Time: 0.243851 seconds
Node: bert/encoder/layer_10/attention/self/Mul, Execution Time: 0.005607 seconds
Node: bert/encoder/layer_10/attention/self/add, Execution Time: 0.002198 seconds
Node: bert/encoder/layer_10/attention/self/Softmax, Execution Time: 0.002806 seconds
Node: bert/encoder/layer_10/attention/self/MatMul_1, Execution Time: 0.004828 seconds
Node: bert/encoder/layer_10/attention/self/transpose_3, Execution Time: 0.000015 seconds
Node: bert/encoder/layer_10/attention/self/Reshape_3, Execution Time: 0.000119 seconds
Matmul Fuse Node: bert/encoder/layer_10/attention/output/dense/MatMul, Execution Time: 0.007352 seconds
Node: bert/encoder/layer_10/attention/output/add, Execution Time: 0.000754 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/mean, Execution Time: 0.000084 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000334 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/SquaredDifference__449, Execution Time: 0.000371 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/variance, Execution Time: 0.000056 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/Rsqrt__451, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000382 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000355 seconds
Matmul Fuse Node: bert/encoder/layer_10/intermediate/dense/MatMul, Execution Time: 0.009775 seconds
Node: bert/encoder/layer_10/intermediate/dense/Pow, Execution Time: 0.016817 seconds
Node: bert/encoder/layer_10/intermediate/dense/mul, Execution Time: 0.009470 seconds
Node: bert/encoder/layer_10/intermediate/dense/add, Execution Time: 0.009489 seconds
Node: bert/encoder/layer_10/intermediate/dense/mul_1, Execution Time: 0.009306 seconds
Node: bert/encoder/layer_10/intermediate/dense/Tanh, Execution Time: 0.016292 seconds
Node: bert/encoder/layer_10/intermediate/dense/add_1, Execution Time: 0.006514 seconds
Node: bert/encoder/layer_10/intermediate/dense/mul_2, Execution Time: 0.006126 seconds
Node: bert/encoder/layer_10/intermediate/dense/mul_3, Execution Time: 0.006132 seconds
Matmul Fuse Node: bert/encoder/layer_10/output/dense/MatMul, Execution Time: 0.006787 seconds
Node: bert/encoder/layer_10/output/add, Execution Time: 0.000428 seconds
Node: bert/encoder/layer_10/output/LayerNorm/moments/mean, Execution Time: 0.000073 seconds
Node: bert/encoder/layer_10/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000032 seconds
Node: bert/encoder/layer_10/output/LayerNorm/moments/SquaredDifference__453, Execution Time: 0.000024 seconds
Node: bert/encoder/layer_10/output/LayerNorm/moments/variance, Execution Time: 0.000040 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/Rsqrt__455, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000042 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000046 seconds
Matmul Fuse Node: bert/encoder/layer_11/attention/self/value/MatMul, Execution Time: 0.004507 seconds
Node: bert/encoder/layer_11/attention/self/Reshape_2, Execution Time: 0.000018 seconds
Node: bert/encoder/layer_11/attention/self/transpose_2, Execution Time: 0.000008 seconds
Matmul Fuse Node: bert/encoder/layer_11/attention/self/query/MatMul, Execution Time: 0.004365 seconds
Node: bert/encoder/layer_11/attention/self/Reshape, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_11/attention/self/transpose, Execution Time: 0.000007 seconds
Matmul Fuse Node: bert/encoder/layer_11/attention/self/key/MatMul, Execution Time: 0.004227 seconds
Node: bert/encoder/layer_11/attention/self/Reshape_1, Execution Time: 0.000012 seconds
Node: bert/encoder/layer_11/attention/self/MatMul__460, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_11/attention/self/MatMul, Execution Time: 0.243756 seconds
Node: bert/encoder/layer_11/attention/self/Mul, Execution Time: 0.005621 seconds
Node: bert/encoder/layer_11/attention/self/add, Execution Time: 0.002222 seconds
Node: bert/encoder/layer_11/attention/self/Softmax, Execution Time: 0.002797 seconds
Node: bert/encoder/layer_11/attention/self/MatMul_1, Execution Time: 0.006723 seconds
Node: bert/encoder/layer_11/attention/self/transpose_3, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_11/attention/self/Reshape_3, Execution Time: 0.000119 seconds
Matmul Fuse Node: bert/encoder/layer_11/attention/output/dense/MatMul, Execution Time: 0.007778 seconds
Node: bert/encoder/layer_11/attention/output/add, Execution Time: 0.000812 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/mean, Execution Time: 0.000087 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000332 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/SquaredDifference__463, Execution Time: 0.000329 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/variance, Execution Time: 0.000057 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/Rsqrt__465, Execution Time: 0.000007 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000379 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000354 seconds
Matmul Fuse Node: bert/encoder/layer_11/intermediate/dense/MatMul, Execution Time: 0.010989 seconds
Node: bert/encoder/layer_11/intermediate/dense/Pow, Execution Time: 0.016669 seconds
Node: bert/encoder/layer_11/intermediate/dense/mul, Execution Time: 0.009426 seconds
Node: bert/encoder/layer_11/intermediate/dense/add, Execution Time: 0.009490 seconds
Node: bert/encoder/layer_11/intermediate/dense/mul_1, Execution Time: 0.009310 seconds
Node: bert/encoder/layer_11/intermediate/dense/Tanh, Execution Time: 0.015682 seconds
Node: bert/encoder/layer_11/intermediate/dense/add_1, Execution Time: 0.006393 seconds
Node: bert/encoder/layer_11/intermediate/dense/mul_2, Execution Time: 0.006030 seconds
Node: bert/encoder/layer_11/intermediate/dense/mul_3, Execution Time: 0.006037 seconds
Matmul Fuse Node: bert/encoder/layer_11/output/dense/MatMul, Execution Time: 0.007656 seconds
Node: bert/encoder/layer_11/output/add, Execution Time: 0.000427 seconds
Node: bert/encoder/layer_11/output/LayerNorm/moments/mean, Execution Time: 0.000074 seconds
Node: bert/encoder/layer_11/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000028 seconds
Node: bert/encoder/layer_11/output/LayerNorm/moments/SquaredDifference__467, Execution Time: 0.000025 seconds
Node: bert/encoder/layer_11/output/LayerNorm/moments/variance, Execution Time: 0.000040 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/Rsqrt__469, Execution Time: 0.000006 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000048 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000046 seconds
Matmul Fuse Node: MatMul, Execution Time: 0.005046 seconds
Node: Reshape_1, Execution Time: 0.000018 seconds
Node: transpose, Execution Time: 0.000008 seconds
Node: unstack, Execution Time: 0.000039 seconds
Node: unstack__490, Execution Time: 0.000005 seconds
Node: unstack__488, Execution Time: 0.000005 seconds

Total Execution Time: 7.840521 seconds

Total Matmul Fuse Execution Time: 3.429674 seconds
Execution complete.
Editor is loading...
Leave a Comment