Untitled
unknown
c_cpp
a month ago
63 kB
1
Indexable
Node Execution Times: Node: unique_ids_graph_outputs_Identity__10, Execution Time: 0.000006 seconds Node: bert/encoder/Shape, Execution Time: 0.000005 seconds Node: bert/encoder/Shape__12, Execution Time: 0.000013 seconds Node: bert/encoder/strided_slice, Execution Time: 0.000082 seconds Node: bert/encoder/strided_slice__16, Execution Time: 0.000006 seconds Node: bert/encoder/strided_slice__17, Execution Time: 0.000007 seconds Node: bert/encoder/ones/packed_Unsqueeze__18, Execution Time: 0.000014 seconds Node: bert/encoder/ones/packed_Concat__21, Execution Time: 0.000014 seconds Node: bert/encoder/ones__22, Execution Time: 0.000006 seconds Node: bert/encoder/ones, Execution Time: 0.000014 seconds Node: bert/encoder/Reshape, Execution Time: 0.000008 seconds Node: bert/encoder/Cast, Execution Time: 0.000006 seconds Node: bert/encoder/mul, Execution Time: 0.000039 seconds Node: bert/encoder/layer_9/attention/self/ExpandDims, Execution Time: 0.000007 seconds Node: bert/encoder/layer_9/attention/self/sub, Execution Time: 0.000018 seconds Node: bert/encoder/layer_9/attention/self/mul_1, Execution Time: 0.000151 seconds Node: bert/embeddings/Reshape_2, Execution Time: 0.000008 seconds Node: bert/embeddings/Reshape, Execution Time: 0.000005 seconds Node: bert/embeddings/GatherV2, Execution Time: 0.000428 seconds Node: bert/embeddings/Reshape_1, Execution Time: 0.000007 seconds Node: bert/embeddings/one_hot, Execution Time: 0.000038 seconds Node: bert/embeddings/MatMul, Execution Time: 0.263444 seconds Node: bert/embeddings/Reshape_3, Execution Time: 0.000031 seconds Node: bert/embeddings/add, Execution Time: 0.000350 seconds Node: bert/embeddings/add_1, Execution Time: 0.000358 seconds Node: bert/embeddings/LayerNorm/moments/mean, Execution Time: 0.000095 seconds Node: bert/embeddings/LayerNorm/moments/SquaredDifference, Execution Time: 0.000312 seconds Node: bert/embeddings/LayerNorm/moments/SquaredDifference__72, Execution Time: 0.000322 seconds Node: bert/embeddings/LayerNorm/moments/variance, Execution Time: 0.000055 seconds Node: bert/embeddings/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds Node: bert/embeddings/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000010 seconds Node: bert/embeddings/LayerNorm/batchnorm/Rsqrt__74, Execution Time: 0.000007 seconds Node: bert/embeddings/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds Node: bert/embeddings/LayerNorm/batchnorm/mul_2, Execution Time: 0.000005 seconds Node: bert/embeddings/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds Node: bert/embeddings/LayerNorm/batchnorm/mul_1, Execution Time: 0.000346 seconds Node: bert/embeddings/LayerNorm/batchnorm/add_1, Execution Time: 0.000359 seconds Node: bert/encoder/Reshape_1, Execution Time: 0.000014 seconds Matmul Fuse Node: bert/encoder/layer_0/attention/self/value/MatMul, Execution Time: 2.923421 seconds Node: bert/encoder/layer_0/attention/self/Reshape_2, Execution Time: 0.000028 seconds Node: bert/encoder/layer_0/attention/self/transpose_2, Execution Time: 0.000008 seconds Matmul Fuse Node: bert/encoder/layer_0/attention/self/query/MatMul, Execution Time: 0.006099 seconds Node: bert/encoder/layer_0/attention/self/Reshape, Execution Time: 0.000018 seconds Node: bert/encoder/layer_0/attention/self/transpose, Execution Time: 0.000009 seconds Matmul Fuse Node: bert/encoder/layer_0/attention/self/key/MatMul, Execution Time: 0.005130 seconds Node: bert/encoder/layer_0/attention/self/Reshape_1, Execution Time: 0.000014 seconds Node: bert/encoder/layer_0/attention/self/MatMul__306, Execution Time: 0.000007 seconds Node: bert/encoder/layer_0/attention/self/MatMul, Execution Time: 0.248202 seconds Node: bert/encoder/layer_0/attention/self/Mul, Execution Time: 0.005624 seconds Node: bert/encoder/layer_0/attention/self/add, Execution Time: 0.002322 seconds Node: bert/encoder/layer_0/attention/self/Softmax, Execution Time: 0.003880 seconds Node: bert/encoder/layer_0/attention/self/MatMul_1, Execution Time: 0.010044 seconds Node: bert/encoder/layer_0/attention/self/transpose_3, Execution Time: 0.000019 seconds Node: bert/encoder/layer_0/attention/self/Reshape_3, Execution Time: 0.000123 seconds Matmul Fuse Node: bert/encoder/layer_0/attention/output/dense/MatMul, Execution Time: 0.017249 seconds Node: bert/encoder/layer_0/attention/output/add, Execution Time: 0.000692 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/mean, Execution Time: 0.000100 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000430 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/SquaredDifference__309, Execution Time: 0.000424 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/variance, Execution Time: 0.000069 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000007 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/Rsqrt__311, Execution Time: 0.000009 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000007 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000005 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000006 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000447 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000469 seconds Matmul Fuse Node: bert/encoder/layer_0/intermediate/dense/MatMul, Execution Time: 0.019850 seconds Node: bert/encoder/layer_0/intermediate/dense/Pow, Execution Time: 0.021974 seconds Node: bert/encoder/layer_0/intermediate/dense/mul, Execution Time: 0.012573 seconds Node: bert/encoder/layer_0/intermediate/dense/add, Execution Time: 0.006631 seconds Node: bert/encoder/layer_0/intermediate/dense/mul_1, Execution Time: 0.005640 seconds Node: bert/encoder/layer_0/intermediate/dense/Tanh, Execution Time: 0.012317 seconds Node: bert/encoder/layer_0/intermediate/dense/add_1, Execution Time: 0.006749 seconds Node: bert/encoder/layer_0/intermediate/dense/mul_2, Execution Time: 0.006286 seconds Node: bert/encoder/layer_0/intermediate/dense/mul_3, Execution Time: 0.006335 seconds Matmul Fuse Node: bert/encoder/layer_0/output/dense/MatMul, Execution Time: 0.006904 seconds Node: bert/encoder/layer_0/output/add, Execution Time: 0.000417 seconds Node: bert/encoder/layer_0/output/LayerNorm/moments/mean, Execution Time: 0.000075 seconds Node: bert/encoder/layer_0/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000026 seconds Node: bert/encoder/layer_0/output/LayerNorm/moments/SquaredDifference__313, Execution Time: 0.000023 seconds Node: bert/encoder/layer_0/output/LayerNorm/moments/variance, Execution Time: 0.000041 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/Rsqrt__315, Execution Time: 0.000006 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul, Execution Time: 0.000004 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000042 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000047 seconds Matmul Fuse Node: bert/encoder/layer_1/attention/self/value/MatMul, Execution Time: 0.004738 seconds Node: bert/encoder/layer_1/attention/self/Reshape_2, Execution Time: 0.000018 seconds Node: bert/encoder/layer_1/attention/self/transpose_2, Execution Time: 0.000009 seconds Matmul Fuse Node: bert/encoder/layer_1/attention/self/query/MatMul, Execution Time: 0.004339 seconds Node: bert/encoder/layer_1/attention/self/Reshape, Execution Time: 0.000014 seconds Node: bert/encoder/layer_1/attention/self/transpose, Execution Time: 0.000007 seconds Matmul Fuse Node: bert/encoder/layer_1/attention/self/key/MatMul, Execution Time: 0.005015 seconds Node: bert/encoder/layer_1/attention/self/Reshape_1, Execution Time: 0.000013 seconds Node: bert/encoder/layer_1/attention/self/MatMul__320, Execution Time: 0.000006 seconds Node: bert/encoder/layer_1/attention/self/MatMul, Execution Time: 0.252038 seconds Node: bert/encoder/layer_1/attention/self/Mul, Execution Time: 0.005617 seconds Node: bert/encoder/layer_1/attention/self/add, Execution Time: 0.002270 seconds Node: bert/encoder/layer_1/attention/self/Softmax, Execution Time: 0.002844 seconds Node: bert/encoder/layer_1/attention/self/MatMul_1, Execution Time: 0.005414 seconds Node: bert/encoder/layer_1/attention/self/transpose_3, Execution Time: 0.000014 seconds Node: bert/encoder/layer_1/attention/self/Reshape_3, Execution Time: 0.000118 seconds Matmul Fuse Node: bert/encoder/layer_1/attention/output/dense/MatMul, Execution Time: 0.006670 seconds Node: bert/encoder/layer_1/attention/output/add, Execution Time: 0.000594 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/mean, Execution Time: 0.000085 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000389 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/SquaredDifference__323, Execution Time: 0.000330 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/variance, Execution Time: 0.000057 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/Rsqrt__325, Execution Time: 0.000007 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000009 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000356 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000360 seconds Matmul Fuse Node: bert/encoder/layer_1/intermediate/dense/MatMul, Execution Time: 0.028470 seconds Node: bert/encoder/layer_1/intermediate/dense/Pow, Execution Time: 0.021227 seconds Node: bert/encoder/layer_1/intermediate/dense/mul, Execution Time: 0.012580 seconds Node: bert/encoder/layer_1/intermediate/dense/add, Execution Time: 0.008196 seconds Node: bert/encoder/layer_1/intermediate/dense/mul_1, Execution Time: 0.005632 seconds Node: bert/encoder/layer_1/intermediate/dense/Tanh, Execution Time: 0.012254 seconds Node: bert/encoder/layer_1/intermediate/dense/add_1, Execution Time: 0.006654 seconds Node: bert/encoder/layer_1/intermediate/dense/mul_2, Execution Time: 0.006237 seconds Node: bert/encoder/layer_1/intermediate/dense/mul_3, Execution Time: 0.006218 seconds Matmul Fuse Node: bert/encoder/layer_1/output/dense/MatMul, Execution Time: 0.006732 seconds Node: bert/encoder/layer_1/output/add, Execution Time: 0.000446 seconds Node: bert/encoder/layer_1/output/LayerNorm/moments/mean, Execution Time: 0.000076 seconds Node: bert/encoder/layer_1/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000031 seconds Node: bert/encoder/layer_1/output/LayerNorm/moments/SquaredDifference__327, Execution Time: 0.000027 seconds Node: bert/encoder/layer_1/output/LayerNorm/moments/variance, Execution Time: 0.000041 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/add, Execution Time: 0.000004 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000003 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/Rsqrt__329, Execution Time: 0.000006 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul, Execution Time: 0.000004 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000051 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000053 seconds Matmul Fuse Node: bert/encoder/layer_2/attention/self/value/MatMul, Execution Time: 0.004555 seconds Node: bert/encoder/layer_2/attention/self/Reshape_2, Execution Time: 0.000017 seconds Node: bert/encoder/layer_2/attention/self/transpose_2, Execution Time: 0.000008 seconds Matmul Fuse Node: bert/encoder/layer_2/attention/self/query/MatMul, Execution Time: 0.004414 seconds Node: bert/encoder/layer_2/attention/self/Reshape, Execution Time: 0.000014 seconds Node: bert/encoder/layer_2/attention/self/transpose, Execution Time: 0.000008 seconds Matmul Fuse Node: bert/encoder/layer_2/attention/self/key/MatMul, Execution Time: 0.004979 seconds Node: bert/encoder/layer_2/attention/self/Reshape_1, Execution Time: 0.000013 seconds Node: bert/encoder/layer_2/attention/self/MatMul__334, Execution Time: 0.000006 seconds Node: bert/encoder/layer_2/attention/self/MatMul, Execution Time: 0.244382 seconds Node: bert/encoder/layer_2/attention/self/Mul, Execution Time: 0.005622 seconds Node: bert/encoder/layer_2/attention/self/add, Execution Time: 0.002254 seconds Node: bert/encoder/layer_2/attention/self/Softmax, Execution Time: 0.003083 seconds Node: bert/encoder/layer_2/attention/self/MatMul_1, Execution Time: 0.005330 seconds Node: bert/encoder/layer_2/attention/self/transpose_3, Execution Time: 0.000015 seconds Node: bert/encoder/layer_2/attention/self/Reshape_3, Execution Time: 0.000120 seconds Matmul Fuse Node: bert/encoder/layer_2/attention/output/dense/MatMul, Execution Time: 0.007471 seconds Node: bert/encoder/layer_2/attention/output/add, Execution Time: 0.000603 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/mean, Execution Time: 0.000089 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000046 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/SquaredDifference__337, Execution Time: 0.000350 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/variance, Execution Time: 0.000060 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/Rsqrt__339, Execution Time: 0.000007 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000006 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000005 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000354 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000359 seconds Matmul Fuse Node: bert/encoder/layer_2/intermediate/dense/MatMul, Execution Time: 0.009079 seconds Node: bert/encoder/layer_2/intermediate/dense/Pow, Execution Time: 0.016791 seconds Node: bert/encoder/layer_2/intermediate/dense/mul, Execution Time: 0.010142 seconds Node: bert/encoder/layer_2/intermediate/dense/add, Execution Time: 0.009470 seconds Node: bert/encoder/layer_2/intermediate/dense/mul_1, Execution Time: 0.009278 seconds Node: bert/encoder/layer_2/intermediate/dense/Tanh, Execution Time: 0.016555 seconds Node: bert/encoder/layer_2/intermediate/dense/add_1, Execution Time: 0.006574 seconds Node: bert/encoder/layer_2/intermediate/dense/mul_2, Execution Time: 0.006185 seconds Node: bert/encoder/layer_2/intermediate/dense/mul_3, Execution Time: 0.006200 seconds Matmul Fuse Node: bert/encoder/layer_2/output/dense/MatMul, Execution Time: 0.006927 seconds Node: bert/encoder/layer_2/output/add, Execution Time: 0.000438 seconds Node: bert/encoder/layer_2/output/LayerNorm/moments/mean, Execution Time: 0.000082 seconds Node: bert/encoder/layer_2/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000030 seconds Node: bert/encoder/layer_2/output/LayerNorm/moments/SquaredDifference__341, Execution Time: 0.000025 seconds Node: bert/encoder/layer_2/output/LayerNorm/moments/variance, Execution Time: 0.000041 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/add, Execution Time: 0.000004 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/Rsqrt__343, Execution Time: 0.000006 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul, Execution Time: 0.000004 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/sub, Execution Time: 0.000003 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000044 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000046 seconds Matmul Fuse Node: bert/encoder/layer_3/attention/self/value/MatMul, Execution Time: 0.004408 seconds Node: bert/encoder/layer_3/attention/self/Reshape_2, Execution Time: 0.000017 seconds Node: bert/encoder/layer_3/attention/self/transpose_2, Execution Time: 0.000009 seconds Matmul Fuse Node: bert/encoder/layer_3/attention/self/query/MatMul, Execution Time: 0.004378 seconds Node: bert/encoder/layer_3/attention/self/Reshape, Execution Time: 0.000013 seconds Node: bert/encoder/layer_3/attention/self/transpose, Execution Time: 0.000007 seconds Matmul Fuse Node: bert/encoder/layer_3/attention/self/key/MatMul, Execution Time: 0.004264 seconds Node: bert/encoder/layer_3/attention/self/Reshape_1, Execution Time: 0.000012 seconds Node: bert/encoder/layer_3/attention/self/MatMul__348, Execution Time: 0.000007 seconds Node: bert/encoder/layer_3/attention/self/MatMul, Execution Time: 0.244595 seconds Node: bert/encoder/layer_3/attention/self/Mul, Execution Time: 0.005615 seconds Node: bert/encoder/layer_3/attention/self/add, Execution Time: 0.002268 seconds Node: bert/encoder/layer_3/attention/self/Softmax, Execution Time: 0.003315 seconds Node: bert/encoder/layer_3/attention/self/MatMul_1, Execution Time: 0.009411 seconds Node: bert/encoder/layer_3/attention/self/transpose_3, Execution Time: 0.000014 seconds Node: bert/encoder/layer_3/attention/self/Reshape_3, Execution Time: 0.000113 seconds Matmul Fuse Node: bert/encoder/layer_3/attention/output/dense/MatMul, Execution Time: 0.009412 seconds Node: bert/encoder/layer_3/attention/output/add, Execution Time: 0.000607 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/mean, Execution Time: 0.000091 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000222 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/SquaredDifference__351, Execution Time: 0.000331 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/variance, Execution Time: 0.000056 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/Rsqrt__353, Execution Time: 0.000007 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000341 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000361 seconds Matmul Fuse Node: bert/encoder/layer_3/intermediate/dense/MatMul, Execution Time: 0.015664 seconds Node: bert/encoder/layer_3/intermediate/dense/Pow, Execution Time: 0.016810 seconds Node: bert/encoder/layer_3/intermediate/dense/mul, Execution Time: 0.010054 seconds Node: bert/encoder/layer_3/intermediate/dense/add, Execution Time: 0.009544 seconds Node: bert/encoder/layer_3/intermediate/dense/mul_1, Execution Time: 0.009331 seconds Node: bert/encoder/layer_3/intermediate/dense/Tanh, Execution Time: 0.013286 seconds Node: bert/encoder/layer_3/intermediate/dense/add_1, Execution Time: 0.006505 seconds Node: bert/encoder/layer_3/intermediate/dense/mul_2, Execution Time: 0.006143 seconds Node: bert/encoder/layer_3/intermediate/dense/mul_3, Execution Time: 0.006172 seconds Matmul Fuse Node: bert/encoder/layer_3/output/dense/MatMul, Execution Time: 0.006868 seconds Node: bert/encoder/layer_3/output/add, Execution Time: 0.000450 seconds Node: bert/encoder/layer_3/output/LayerNorm/moments/mean, Execution Time: 0.000075 seconds Node: bert/encoder/layer_3/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000031 seconds Node: bert/encoder/layer_3/output/LayerNorm/moments/SquaredDifference__355, Execution Time: 0.000026 seconds Node: bert/encoder/layer_3/output/LayerNorm/moments/variance, Execution Time: 0.000040 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/Rsqrt__357, Execution Time: 0.000006 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/sub, Execution Time: 0.000003 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000042 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000055 seconds Matmul Fuse Node: bert/encoder/layer_4/attention/self/value/MatMul, Execution Time: 0.004518 seconds Node: bert/encoder/layer_4/attention/self/Reshape_2, Execution Time: 0.000017 seconds Node: bert/encoder/layer_4/attention/self/transpose_2, Execution Time: 0.000008 seconds Matmul Fuse Node: bert/encoder/layer_4/attention/self/query/MatMul, Execution Time: 0.004355 seconds Node: bert/encoder/layer_4/attention/self/Reshape, Execution Time: 0.000014 seconds Node: bert/encoder/layer_4/attention/self/transpose, Execution Time: 0.000007 seconds Matmul Fuse Node: bert/encoder/layer_4/attention/self/key/MatMul, Execution Time: 0.004283 seconds Node: bert/encoder/layer_4/attention/self/Reshape_1, Execution Time: 0.000012 seconds Node: bert/encoder/layer_4/attention/self/MatMul__362, Execution Time: 0.000006 seconds Node: bert/encoder/layer_4/attention/self/MatMul, Execution Time: 0.244649 seconds Node: bert/encoder/layer_4/attention/self/Mul, Execution Time: 0.005620 seconds Node: bert/encoder/layer_4/attention/self/add, Execution Time: 0.002235 seconds Node: bert/encoder/layer_4/attention/self/Softmax, Execution Time: 0.002923 seconds Node: bert/encoder/layer_4/attention/self/MatMul_1, Execution Time: 0.009138 seconds Node: bert/encoder/layer_4/attention/self/transpose_3, Execution Time: 0.000017 seconds Node: bert/encoder/layer_4/attention/self/Reshape_3, Execution Time: 0.000118 seconds Matmul Fuse Node: bert/encoder/layer_4/attention/output/dense/MatMul, Execution Time: 0.008332 seconds Node: bert/encoder/layer_4/attention/output/add, Execution Time: 0.000610 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/mean, Execution Time: 0.000092 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000041 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/SquaredDifference__365, Execution Time: 0.000201 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/variance, Execution Time: 0.000056 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/Rsqrt__367, Execution Time: 0.000007 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000347 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000363 seconds Matmul Fuse Node: bert/encoder/layer_4/intermediate/dense/MatMul, Execution Time: 0.014208 seconds Node: bert/encoder/layer_4/intermediate/dense/Pow, Execution Time: 0.016982 seconds Node: bert/encoder/layer_4/intermediate/dense/mul, Execution Time: 0.010030 seconds Node: bert/encoder/layer_4/intermediate/dense/add, Execution Time: 0.009479 seconds Node: bert/encoder/layer_4/intermediate/dense/mul_1, Execution Time: 0.009355 seconds Node: bert/encoder/layer_4/intermediate/dense/Tanh, Execution Time: 0.014290 seconds Node: bert/encoder/layer_4/intermediate/dense/add_1, Execution Time: 0.006647 seconds Node: bert/encoder/layer_4/intermediate/dense/mul_2, Execution Time: 0.006236 seconds Node: bert/encoder/layer_4/intermediate/dense/mul_3, Execution Time: 0.006242 seconds Matmul Fuse Node: bert/encoder/layer_4/output/dense/MatMul, Execution Time: 0.006896 seconds Node: bert/encoder/layer_4/output/add, Execution Time: 0.000458 seconds Node: bert/encoder/layer_4/output/LayerNorm/moments/mean, Execution Time: 0.000075 seconds Node: bert/encoder/layer_4/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000031 seconds Node: bert/encoder/layer_4/output/LayerNorm/moments/SquaredDifference__369, Execution Time: 0.000025 seconds Node: bert/encoder/layer_4/output/LayerNorm/moments/variance, Execution Time: 0.000041 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/Rsqrt__371, Execution Time: 0.000006 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul, Execution Time: 0.000004 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000046 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000046 seconds Matmul Fuse Node: bert/encoder/layer_5/attention/self/value/MatMul, Execution Time: 0.004612 seconds Node: bert/encoder/layer_5/attention/self/Reshape_2, Execution Time: 0.000016 seconds Node: bert/encoder/layer_5/attention/self/transpose_2, Execution Time: 0.000009 seconds Matmul Fuse Node: bert/encoder/layer_5/attention/self/query/MatMul, Execution Time: 0.004437 seconds Node: bert/encoder/layer_5/attention/self/Reshape, Execution Time: 0.000015 seconds Node: bert/encoder/layer_5/attention/self/transpose, Execution Time: 0.000007 seconds Matmul Fuse Node: bert/encoder/layer_5/attention/self/key/MatMul, Execution Time: 0.004299 seconds Node: bert/encoder/layer_5/attention/self/Reshape_1, Execution Time: 0.000014 seconds Node: bert/encoder/layer_5/attention/self/MatMul__376, Execution Time: 0.000008 seconds Node: bert/encoder/layer_5/attention/self/MatMul, Execution Time: 0.244592 seconds Node: bert/encoder/layer_5/attention/self/Mul, Execution Time: 0.005615 seconds Node: bert/encoder/layer_5/attention/self/add, Execution Time: 0.002190 seconds Node: bert/encoder/layer_5/attention/self/Softmax, Execution Time: 0.002858 seconds Node: bert/encoder/layer_5/attention/self/MatMul_1, Execution Time: 0.004663 seconds Node: bert/encoder/layer_5/attention/self/transpose_3, Execution Time: 0.000015 seconds Node: bert/encoder/layer_5/attention/self/Reshape_3, Execution Time: 0.000123 seconds Matmul Fuse Node: bert/encoder/layer_5/attention/output/dense/MatMul, Execution Time: 0.007522 seconds Node: bert/encoder/layer_5/attention/output/add, Execution Time: 0.000611 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/mean, Execution Time: 0.000089 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000026 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/SquaredDifference__379, Execution Time: 0.000326 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/variance, Execution Time: 0.000059 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/Rsqrt__381, Execution Time: 0.000007 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000005 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000341 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000356 seconds Matmul Fuse Node: bert/encoder/layer_5/intermediate/dense/MatMul, Execution Time: 0.007535 seconds Node: bert/encoder/layer_5/intermediate/dense/Pow, Execution Time: 0.016971 seconds Node: bert/encoder/layer_5/intermediate/dense/mul, Execution Time: 0.010106 seconds Node: bert/encoder/layer_5/intermediate/dense/add, Execution Time: 0.009492 seconds Node: bert/encoder/layer_5/intermediate/dense/mul_1, Execution Time: 0.009312 seconds Node: bert/encoder/layer_5/intermediate/dense/Tanh, Execution Time: 0.017089 seconds Node: bert/encoder/layer_5/intermediate/dense/add_1, Execution Time: 0.006615 seconds Node: bert/encoder/layer_5/intermediate/dense/mul_2, Execution Time: 0.006253 seconds Node: bert/encoder/layer_5/intermediate/dense/mul_3, Execution Time: 0.006204 seconds Matmul Fuse Node: bert/encoder/layer_5/output/dense/MatMul, Execution Time: 0.007736 seconds Node: bert/encoder/layer_5/output/add, Execution Time: 0.000471 seconds Node: bert/encoder/layer_5/output/LayerNorm/moments/mean, Execution Time: 0.000078 seconds Node: bert/encoder/layer_5/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000037 seconds Node: bert/encoder/layer_5/output/LayerNorm/moments/SquaredDifference__383, Execution Time: 0.000029 seconds Node: bert/encoder/layer_5/output/LayerNorm/moments/variance, Execution Time: 0.000041 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/Rsqrt__385, Execution Time: 0.000006 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000053 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000049 seconds Matmul Fuse Node: bert/encoder/layer_6/attention/self/value/MatMul, Execution Time: 0.005228 seconds Node: bert/encoder/layer_6/attention/self/Reshape_2, Execution Time: 0.000018 seconds Node: bert/encoder/layer_6/attention/self/transpose_2, Execution Time: 0.000008 seconds Matmul Fuse Node: bert/encoder/layer_6/attention/self/query/MatMul, Execution Time: 0.004674 seconds Node: bert/encoder/layer_6/attention/self/Reshape, Execution Time: 0.000014 seconds Node: bert/encoder/layer_6/attention/self/transpose, Execution Time: 0.000007 seconds Matmul Fuse Node: bert/encoder/layer_6/attention/self/key/MatMul, Execution Time: 0.004387 seconds Node: bert/encoder/layer_6/attention/self/Reshape_1, Execution Time: 0.000013 seconds Node: bert/encoder/layer_6/attention/self/MatMul__390, Execution Time: 0.000006 seconds Node: bert/encoder/layer_6/attention/self/MatMul, Execution Time: 0.244419 seconds Node: bert/encoder/layer_6/attention/self/Mul, Execution Time: 0.005610 seconds Node: bert/encoder/layer_6/attention/self/add, Execution Time: 0.002240 seconds Node: bert/encoder/layer_6/attention/self/Softmax, Execution Time: 0.002904 seconds Node: bert/encoder/layer_6/attention/self/MatMul_1, Execution Time: 0.004638 seconds Node: bert/encoder/layer_6/attention/self/transpose_3, Execution Time: 0.000015 seconds Node: bert/encoder/layer_6/attention/self/Reshape_3, Execution Time: 0.000122 seconds Matmul Fuse Node: bert/encoder/layer_6/attention/output/dense/MatMul, Execution Time: 0.007547 seconds Node: bert/encoder/layer_6/attention/output/add, Execution Time: 0.000606 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/mean, Execution Time: 0.000085 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000046 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/SquaredDifference__393, Execution Time: 0.000335 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/variance, Execution Time: 0.000057 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000007 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/Rsqrt__395, Execution Time: 0.000007 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000006 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000005 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000345 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000351 seconds Matmul Fuse Node: bert/encoder/layer_6/intermediate/dense/MatMul, Execution Time: 0.008843 seconds Node: bert/encoder/layer_6/intermediate/dense/Pow, Execution Time: 0.016976 seconds Node: bert/encoder/layer_6/intermediate/dense/mul, Execution Time: 0.010055 seconds Node: bert/encoder/layer_6/intermediate/dense/add, Execution Time: 0.009470 seconds Node: bert/encoder/layer_6/intermediate/dense/mul_1, Execution Time: 0.009349 seconds Node: bert/encoder/layer_6/intermediate/dense/Tanh, Execution Time: 0.016520 seconds Node: bert/encoder/layer_6/intermediate/dense/add_1, Execution Time: 0.006582 seconds Node: bert/encoder/layer_6/intermediate/dense/mul_2, Execution Time: 0.006221 seconds Node: bert/encoder/layer_6/intermediate/dense/mul_3, Execution Time: 0.006184 seconds Matmul Fuse Node: bert/encoder/layer_6/output/dense/MatMul, Execution Time: 0.006756 seconds Node: bert/encoder/layer_6/output/add, Execution Time: 0.000442 seconds Node: bert/encoder/layer_6/output/LayerNorm/moments/mean, Execution Time: 0.000077 seconds Node: bert/encoder/layer_6/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000033 seconds Node: bert/encoder/layer_6/output/LayerNorm/moments/SquaredDifference__397, Execution Time: 0.000030 seconds Node: bert/encoder/layer_6/output/LayerNorm/moments/variance, Execution Time: 0.000042 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/Rsqrt__399, Execution Time: 0.000006 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000043 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000044 seconds Matmul Fuse Node: bert/encoder/layer_7/attention/self/value/MatMul, Execution Time: 0.005215 seconds Node: bert/encoder/layer_7/attention/self/Reshape_2, Execution Time: 0.000017 seconds Node: bert/encoder/layer_7/attention/self/transpose_2, Execution Time: 0.000009 seconds Matmul Fuse Node: bert/encoder/layer_7/attention/self/query/MatMul, Execution Time: 0.004282 seconds Node: bert/encoder/layer_7/attention/self/Reshape, Execution Time: 0.000013 seconds Node: bert/encoder/layer_7/attention/self/transpose, Execution Time: 0.000011 seconds Matmul Fuse Node: bert/encoder/layer_7/attention/self/key/MatMul, Execution Time: 0.004284 seconds Node: bert/encoder/layer_7/attention/self/Reshape_1, Execution Time: 0.000013 seconds Node: bert/encoder/layer_7/attention/self/MatMul__404, Execution Time: 0.000006 seconds Node: bert/encoder/layer_7/attention/self/MatMul, Execution Time: 0.244721 seconds Node: bert/encoder/layer_7/attention/self/Mul, Execution Time: 0.005610 seconds Node: bert/encoder/layer_7/attention/self/add, Execution Time: 0.002252 seconds Node: bert/encoder/layer_7/attention/self/Softmax, Execution Time: 0.002888 seconds Node: bert/encoder/layer_7/attention/self/MatMul_1, Execution Time: 0.005186 seconds Node: bert/encoder/layer_7/attention/self/transpose_3, Execution Time: 0.000015 seconds Node: bert/encoder/layer_7/attention/self/Reshape_3, Execution Time: 0.000122 seconds Matmul Fuse Node: bert/encoder/layer_7/attention/output/dense/MatMul, Execution Time: 0.008101 seconds Node: bert/encoder/layer_7/attention/output/add, Execution Time: 0.000598 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/mean, Execution Time: 0.000086 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000207 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/SquaredDifference__407, Execution Time: 0.000324 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/variance, Execution Time: 0.000059 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/Rsqrt__409, Execution Time: 0.000007 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000343 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000369 seconds Matmul Fuse Node: bert/encoder/layer_7/intermediate/dense/MatMul, Execution Time: 0.015323 seconds Node: bert/encoder/layer_7/intermediate/dense/Pow, Execution Time: 0.016762 seconds Node: bert/encoder/layer_7/intermediate/dense/mul, Execution Time: 0.010088 seconds Node: bert/encoder/layer_7/intermediate/dense/add, Execution Time: 0.009523 seconds Node: bert/encoder/layer_7/intermediate/dense/mul_1, Execution Time: 0.009305 seconds Node: bert/encoder/layer_7/intermediate/dense/Tanh, Execution Time: 0.013894 seconds Node: bert/encoder/layer_7/intermediate/dense/add_1, Execution Time: 0.006436 seconds Node: bert/encoder/layer_7/intermediate/dense/mul_2, Execution Time: 0.006119 seconds Node: bert/encoder/layer_7/intermediate/dense/mul_3, Execution Time: 0.006081 seconds Matmul Fuse Node: bert/encoder/layer_7/output/dense/MatMul, Execution Time: 0.006754 seconds Node: bert/encoder/layer_7/output/add, Execution Time: 0.000457 seconds Node: bert/encoder/layer_7/output/LayerNorm/moments/mean, Execution Time: 0.000075 seconds Node: bert/encoder/layer_7/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000035 seconds Node: bert/encoder/layer_7/output/LayerNorm/moments/SquaredDifference__411, Execution Time: 0.000024 seconds Node: bert/encoder/layer_7/output/LayerNorm/moments/variance, Execution Time: 0.000041 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/Rsqrt__413, Execution Time: 0.000006 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000044 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000043 seconds Matmul Fuse Node: bert/encoder/layer_8/attention/self/value/MatMul, Execution Time: 0.004354 seconds Node: bert/encoder/layer_8/attention/self/Reshape_2, Execution Time: 0.000018 seconds Node: bert/encoder/layer_8/attention/self/transpose_2, Execution Time: 0.000008 seconds Matmul Fuse Node: bert/encoder/layer_8/attention/self/query/MatMul, Execution Time: 0.004952 seconds Node: bert/encoder/layer_8/attention/self/Reshape, Execution Time: 0.000014 seconds Node: bert/encoder/layer_8/attention/self/transpose, Execution Time: 0.000007 seconds Matmul Fuse Node: bert/encoder/layer_8/attention/self/key/MatMul, Execution Time: 0.004135 seconds Node: bert/encoder/layer_8/attention/self/Reshape_1, Execution Time: 0.000012 seconds Node: bert/encoder/layer_8/attention/self/MatMul__418, Execution Time: 0.000007 seconds Node: bert/encoder/layer_8/attention/self/MatMul, Execution Time: 0.243845 seconds Node: bert/encoder/layer_8/attention/self/Mul, Execution Time: 0.005615 seconds Node: bert/encoder/layer_8/attention/self/add, Execution Time: 0.002218 seconds Node: bert/encoder/layer_8/attention/self/Softmax, Execution Time: 0.002845 seconds Node: bert/encoder/layer_8/attention/self/MatMul_1, Execution Time: 0.004486 seconds Node: bert/encoder/layer_8/attention/self/transpose_3, Execution Time: 0.000014 seconds Node: bert/encoder/layer_8/attention/self/Reshape_3, Execution Time: 0.000125 seconds Matmul Fuse Node: bert/encoder/layer_8/attention/output/dense/MatMul, Execution Time: 0.007337 seconds Node: bert/encoder/layer_8/attention/output/add, Execution Time: 0.000602 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/mean, Execution Time: 0.000088 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000333 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/SquaredDifference__421, Execution Time: 0.000367 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/variance, Execution Time: 0.000057 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/Rsqrt__423, Execution Time: 0.000007 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000353 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000353 seconds Matmul Fuse Node: bert/encoder/layer_8/intermediate/dense/MatMul, Execution Time: 0.007715 seconds Node: bert/encoder/layer_8/intermediate/dense/Pow, Execution Time: 0.016644 seconds Node: bert/encoder/layer_8/intermediate/dense/mul, Execution Time: 0.010030 seconds Node: bert/encoder/layer_8/intermediate/dense/add, Execution Time: 0.009488 seconds Node: bert/encoder/layer_8/intermediate/dense/mul_1, Execution Time: 0.009296 seconds Node: bert/encoder/layer_8/intermediate/dense/Tanh, Execution Time: 0.016915 seconds Node: bert/encoder/layer_8/intermediate/dense/add_1, Execution Time: 0.006346 seconds Node: bert/encoder/layer_8/intermediate/dense/mul_2, Execution Time: 0.006014 seconds Node: bert/encoder/layer_8/intermediate/dense/mul_3, Execution Time: 0.006008 seconds Matmul Fuse Node: bert/encoder/layer_8/output/dense/MatMul, Execution Time: 0.006807 seconds Node: bert/encoder/layer_8/output/add, Execution Time: 0.000453 seconds Node: bert/encoder/layer_8/output/LayerNorm/moments/mean, Execution Time: 0.000076 seconds Node: bert/encoder/layer_8/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000029 seconds Node: bert/encoder/layer_8/output/LayerNorm/moments/SquaredDifference__425, Execution Time: 0.000024 seconds Node: bert/encoder/layer_8/output/LayerNorm/moments/variance, Execution Time: 0.000041 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/Rsqrt__427, Execution Time: 0.000006 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/sub, Execution Time: 0.000010 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000046 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000043 seconds Matmul Fuse Node: bert/encoder/layer_9/attention/self/value/MatMul, Execution Time: 0.004432 seconds Node: bert/encoder/layer_9/attention/self/Reshape_2, Execution Time: 0.000018 seconds Node: bert/encoder/layer_9/attention/self/transpose_2, Execution Time: 0.000008 seconds Matmul Fuse Node: bert/encoder/layer_9/attention/self/query/MatMul, Execution Time: 0.004335 seconds Node: bert/encoder/layer_9/attention/self/Reshape, Execution Time: 0.000014 seconds Node: bert/encoder/layer_9/attention/self/transpose, Execution Time: 0.000007 seconds Matmul Fuse Node: bert/encoder/layer_9/attention/self/key/MatMul, Execution Time: 0.004863 seconds Node: bert/encoder/layer_9/attention/self/Reshape_1, Execution Time: 0.000012 seconds Node: bert/encoder/layer_9/attention/self/MatMul__432, Execution Time: 0.000006 seconds Node: bert/encoder/layer_9/attention/self/MatMul, Execution Time: 0.244467 seconds Node: bert/encoder/layer_9/attention/self/Mul, Execution Time: 0.005625 seconds Node: bert/encoder/layer_9/attention/self/add, Execution Time: 0.002209 seconds Node: bert/encoder/layer_9/attention/self/Softmax, Execution Time: 0.003450 seconds Node: bert/encoder/layer_9/attention/self/MatMul_1, Execution Time: 0.004668 seconds Node: bert/encoder/layer_9/attention/self/transpose_3, Execution Time: 0.000015 seconds Node: bert/encoder/layer_9/attention/self/Reshape_3, Execution Time: 0.000119 seconds Matmul Fuse Node: bert/encoder/layer_9/attention/output/dense/MatMul, Execution Time: 0.007369 seconds Node: bert/encoder/layer_9/attention/output/add, Execution Time: 0.000593 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/mean, Execution Time: 0.000087 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000219 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/SquaredDifference__435, Execution Time: 0.000331 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/variance, Execution Time: 0.000057 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/Rsqrt__437, Execution Time: 0.000007 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000348 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000354 seconds Matmul Fuse Node: bert/encoder/layer_9/intermediate/dense/MatMul, Execution Time: 0.007658 seconds Node: bert/encoder/layer_9/intermediate/dense/Pow, Execution Time: 0.016806 seconds Node: bert/encoder/layer_9/intermediate/dense/mul, Execution Time: 0.010078 seconds Node: bert/encoder/layer_9/intermediate/dense/add, Execution Time: 0.009510 seconds Node: bert/encoder/layer_9/intermediate/dense/mul_1, Execution Time: 0.009300 seconds Node: bert/encoder/layer_9/intermediate/dense/Tanh, Execution Time: 0.016968 seconds Node: bert/encoder/layer_9/intermediate/dense/add_1, Execution Time: 0.006485 seconds Node: bert/encoder/layer_9/intermediate/dense/mul_2, Execution Time: 0.006137 seconds Node: bert/encoder/layer_9/intermediate/dense/mul_3, Execution Time: 0.006101 seconds Matmul Fuse Node: bert/encoder/layer_9/output/dense/MatMul, Execution Time: 0.006950 seconds Node: bert/encoder/layer_9/output/add, Execution Time: 0.000457 seconds Node: bert/encoder/layer_9/output/LayerNorm/moments/mean, Execution Time: 0.000075 seconds Node: bert/encoder/layer_9/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000036 seconds Node: bert/encoder/layer_9/output/LayerNorm/moments/SquaredDifference__439, Execution Time: 0.000025 seconds Node: bert/encoder/layer_9/output/LayerNorm/moments/variance, Execution Time: 0.000044 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/Rsqrt__441, Execution Time: 0.000006 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul, Execution Time: 0.000004 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000048 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000049 seconds Matmul Fuse Node: bert/encoder/layer_10/attention/self/value/MatMul, Execution Time: 0.004430 seconds Node: bert/encoder/layer_10/attention/self/Reshape_2, Execution Time: 0.000018 seconds Node: bert/encoder/layer_10/attention/self/transpose_2, Execution Time: 0.000008 seconds Matmul Fuse Node: bert/encoder/layer_10/attention/self/query/MatMul, Execution Time: 0.004482 seconds Node: bert/encoder/layer_10/attention/self/Reshape, Execution Time: 0.000014 seconds Node: bert/encoder/layer_10/attention/self/transpose, Execution Time: 0.000008 seconds Matmul Fuse Node: bert/encoder/layer_10/attention/self/key/MatMul, Execution Time: 0.004213 seconds Node: bert/encoder/layer_10/attention/self/Reshape_1, Execution Time: 0.000013 seconds Node: bert/encoder/layer_10/attention/self/MatMul__446, Execution Time: 0.000007 seconds Node: bert/encoder/layer_10/attention/self/MatMul, Execution Time: 0.243851 seconds Node: bert/encoder/layer_10/attention/self/Mul, Execution Time: 0.005607 seconds Node: bert/encoder/layer_10/attention/self/add, Execution Time: 0.002198 seconds Node: bert/encoder/layer_10/attention/self/Softmax, Execution Time: 0.002806 seconds Node: bert/encoder/layer_10/attention/self/MatMul_1, Execution Time: 0.004828 seconds Node: bert/encoder/layer_10/attention/self/transpose_3, Execution Time: 0.000015 seconds Node: bert/encoder/layer_10/attention/self/Reshape_3, Execution Time: 0.000119 seconds Matmul Fuse Node: bert/encoder/layer_10/attention/output/dense/MatMul, Execution Time: 0.007352 seconds Node: bert/encoder/layer_10/attention/output/add, Execution Time: 0.000754 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/mean, Execution Time: 0.000084 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000334 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/SquaredDifference__449, Execution Time: 0.000371 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/variance, Execution Time: 0.000056 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/Rsqrt__451, Execution Time: 0.000006 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000005 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000382 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000355 seconds Matmul Fuse Node: bert/encoder/layer_10/intermediate/dense/MatMul, Execution Time: 0.009775 seconds Node: bert/encoder/layer_10/intermediate/dense/Pow, Execution Time: 0.016817 seconds Node: bert/encoder/layer_10/intermediate/dense/mul, Execution Time: 0.009470 seconds Node: bert/encoder/layer_10/intermediate/dense/add, Execution Time: 0.009489 seconds Node: bert/encoder/layer_10/intermediate/dense/mul_1, Execution Time: 0.009306 seconds Node: bert/encoder/layer_10/intermediate/dense/Tanh, Execution Time: 0.016292 seconds Node: bert/encoder/layer_10/intermediate/dense/add_1, Execution Time: 0.006514 seconds Node: bert/encoder/layer_10/intermediate/dense/mul_2, Execution Time: 0.006126 seconds Node: bert/encoder/layer_10/intermediate/dense/mul_3, Execution Time: 0.006132 seconds Matmul Fuse Node: bert/encoder/layer_10/output/dense/MatMul, Execution Time: 0.006787 seconds Node: bert/encoder/layer_10/output/add, Execution Time: 0.000428 seconds Node: bert/encoder/layer_10/output/LayerNorm/moments/mean, Execution Time: 0.000073 seconds Node: bert/encoder/layer_10/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000032 seconds Node: bert/encoder/layer_10/output/LayerNorm/moments/SquaredDifference__453, Execution Time: 0.000024 seconds Node: bert/encoder/layer_10/output/LayerNorm/moments/variance, Execution Time: 0.000040 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/Rsqrt__455, Execution Time: 0.000005 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul, Execution Time: 0.000004 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000003 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000042 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000046 seconds Matmul Fuse Node: bert/encoder/layer_11/attention/self/value/MatMul, Execution Time: 0.004507 seconds Node: bert/encoder/layer_11/attention/self/Reshape_2, Execution Time: 0.000018 seconds Node: bert/encoder/layer_11/attention/self/transpose_2, Execution Time: 0.000008 seconds Matmul Fuse Node: bert/encoder/layer_11/attention/self/query/MatMul, Execution Time: 0.004365 seconds Node: bert/encoder/layer_11/attention/self/Reshape, Execution Time: 0.000014 seconds Node: bert/encoder/layer_11/attention/self/transpose, Execution Time: 0.000007 seconds Matmul Fuse Node: bert/encoder/layer_11/attention/self/key/MatMul, Execution Time: 0.004227 seconds Node: bert/encoder/layer_11/attention/self/Reshape_1, Execution Time: 0.000012 seconds Node: bert/encoder/layer_11/attention/self/MatMul__460, Execution Time: 0.000007 seconds Node: bert/encoder/layer_11/attention/self/MatMul, Execution Time: 0.243756 seconds Node: bert/encoder/layer_11/attention/self/Mul, Execution Time: 0.005621 seconds Node: bert/encoder/layer_11/attention/self/add, Execution Time: 0.002222 seconds Node: bert/encoder/layer_11/attention/self/Softmax, Execution Time: 0.002797 seconds Node: bert/encoder/layer_11/attention/self/MatMul_1, Execution Time: 0.006723 seconds Node: bert/encoder/layer_11/attention/self/transpose_3, Execution Time: 0.000014 seconds Node: bert/encoder/layer_11/attention/self/Reshape_3, Execution Time: 0.000119 seconds Matmul Fuse Node: bert/encoder/layer_11/attention/output/dense/MatMul, Execution Time: 0.007778 seconds Node: bert/encoder/layer_11/attention/output/add, Execution Time: 0.000812 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/mean, Execution Time: 0.000087 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000332 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/SquaredDifference__463, Execution Time: 0.000329 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/variance, Execution Time: 0.000057 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000006 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000005 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/Rsqrt__465, Execution Time: 0.000007 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000006 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000005 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000005 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000379 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000354 seconds Matmul Fuse Node: bert/encoder/layer_11/intermediate/dense/MatMul, Execution Time: 0.010989 seconds Node: bert/encoder/layer_11/intermediate/dense/Pow, Execution Time: 0.016669 seconds Node: bert/encoder/layer_11/intermediate/dense/mul, Execution Time: 0.009426 seconds Node: bert/encoder/layer_11/intermediate/dense/add, Execution Time: 0.009490 seconds Node: bert/encoder/layer_11/intermediate/dense/mul_1, Execution Time: 0.009310 seconds Node: bert/encoder/layer_11/intermediate/dense/Tanh, Execution Time: 0.015682 seconds Node: bert/encoder/layer_11/intermediate/dense/add_1, Execution Time: 0.006393 seconds Node: bert/encoder/layer_11/intermediate/dense/mul_2, Execution Time: 0.006030 seconds Node: bert/encoder/layer_11/intermediate/dense/mul_3, Execution Time: 0.006037 seconds Matmul Fuse Node: bert/encoder/layer_11/output/dense/MatMul, Execution Time: 0.007656 seconds Node: bert/encoder/layer_11/output/add, Execution Time: 0.000427 seconds Node: bert/encoder/layer_11/output/LayerNorm/moments/mean, Execution Time: 0.000074 seconds Node: bert/encoder/layer_11/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000028 seconds Node: bert/encoder/layer_11/output/LayerNorm/moments/SquaredDifference__467, Execution Time: 0.000025 seconds Node: bert/encoder/layer_11/output/LayerNorm/moments/variance, Execution Time: 0.000040 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/add, Execution Time: 0.000005 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000004 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/Rsqrt__469, Execution Time: 0.000006 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul, Execution Time: 0.000005 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000004 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/sub, Execution Time: 0.000004 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000048 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000046 seconds Matmul Fuse Node: MatMul, Execution Time: 0.005046 seconds Node: Reshape_1, Execution Time: 0.000018 seconds Node: transpose, Execution Time: 0.000008 seconds Node: unstack, Execution Time: 0.000039 seconds Node: unstack__490, Execution Time: 0.000005 seconds Node: unstack__488, Execution Time: 0.000005 seconds Total Execution Time: 7.840521 seconds Total Matmul Fuse Execution Time: 3.429674 seconds Execution complete.
Editor is loading...
Leave a Comment