Untitled
unknown
c_cpp
2 months ago
64 kB
1
Indexable
Node Execution Times: Node: unique_ids_graph_outputs_Identity__10, Execution Time: 0.000004 seconds Node: bert/encoder/Shape, Execution Time: 0.000004 seconds Node: bert/encoder/Shape__12, Execution Time: 0.000009 seconds Node: bert/encoder/strided_slice, Execution Time: 0.000064 seconds Node: bert/encoder/strided_slice__16, Execution Time: 0.000005 seconds Node: bert/encoder/strided_slice__17, Execution Time: 0.000005 seconds Node: bert/encoder/ones/packed_Unsqueeze__18, Execution Time: 0.000011 seconds Node: bert/encoder/ones/packed_Concat__21, Execution Time: 0.000010 seconds Node: bert/encoder/ones__22, Execution Time: 0.000004 seconds Node: bert/encoder/ones, Execution Time: 0.000009 seconds Node: bert/encoder/Reshape, Execution Time: 0.000006 seconds Node: bert/encoder/Cast, Execution Time: 0.000004 seconds Node: bert/encoder/mul, Execution Time: 0.258719 seconds Node: bert/encoder/layer_9/attention/self/ExpandDims, Execution Time: 0.000040 seconds Node: bert/encoder/layer_9/attention/self/sub, Execution Time: 0.006741 seconds Node: bert/encoder/layer_9/attention/self/mul_1, Execution Time: 0.000355 seconds Node: bert/embeddings/Reshape_2, Execution Time: 0.000028 seconds Node: bert/embeddings/Reshape, Execution Time: 0.000005 seconds Node: bert/embeddings/GatherV2, Execution Time: 0.000246 seconds Node: bert/embeddings/Reshape_1, Execution Time: 0.000011 seconds Node: bert/embeddings/one_hot, Execution Time: 0.000056 seconds Node: bert/embeddings/MatMul, Execution Time: 0.066620 seconds Node: bert/embeddings/Reshape_3, Execution Time: 0.000041 seconds Node: bert/embeddings/add, Execution Time: 0.002206 seconds Node: bert/embeddings/add_1, Execution Time: 0.001002 seconds Node: bert/embeddings/LayerNorm/moments/mean, Execution Time: 0.005410 seconds Node: bert/embeddings/LayerNorm/moments/SquaredDifference, Execution Time: 0.000714 seconds Node: bert/embeddings/LayerNorm/moments/SquaredDifference__72, Execution Time: 0.000857 seconds Node: bert/embeddings/LayerNorm/moments/variance, Execution Time: 0.000269 seconds Node: bert/embeddings/LayerNorm/batchnorm/add, Execution Time: 0.000085 seconds Node: bert/embeddings/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.010015 seconds Node: bert/embeddings/LayerNorm/batchnorm/Rsqrt__74, Execution Time: 0.005309 seconds Node: bert/embeddings/LayerNorm/batchnorm/mul, Execution Time: 0.000105 seconds Node: bert/embeddings/LayerNorm/batchnorm/mul_2, Execution Time: 0.000080 seconds Node: bert/embeddings/LayerNorm/batchnorm/sub, Execution Time: 0.000085 seconds Node: bert/embeddings/LayerNorm/batchnorm/mul_1, Execution Time: 0.000665 seconds Node: bert/embeddings/LayerNorm/batchnorm/add_1, Execution Time: 0.000746 seconds Node: bert/encoder/Reshape_1, Execution Time: 0.000034 seconds Matmul Fuse Node: bert/encoder/layer_0/attention/self/value/MatMul, Execution Time: 0.002007 seconds Node: bert/encoder/layer_0/attention/self/Reshape_2, Execution Time: 0.000011 seconds Node: bert/encoder/layer_0/attention/self/transpose_2, Execution Time: 0.000300 seconds Matmul Fuse Node: bert/encoder/layer_0/attention/self/query/MatMul, Execution Time: 0.000945 seconds Node: bert/encoder/layer_0/attention/self/Reshape, Execution Time: 0.000010 seconds Node: bert/encoder/layer_0/attention/self/transpose, Execution Time: 0.000238 seconds Matmul Fuse Node: bert/encoder/layer_0/attention/self/key/MatMul, Execution Time: 0.000931 seconds Node: bert/encoder/layer_0/attention/self/Reshape_1, Execution Time: 0.000010 seconds Node: bert/encoder/layer_0/attention/self/MatMul__306, Execution Time: 0.000242 seconds Node: bert/encoder/layer_0/attention/self/MatMul, Execution Time: 0.004421 seconds Node: bert/encoder/layer_0/attention/self/Mul, Execution Time: 0.001289 seconds Node: bert/encoder/layer_0/attention/self/add, Execution Time: 0.001817 seconds Node: bert/encoder/layer_0/attention/self/Softmax, Execution Time: 0.009955 seconds Node: bert/encoder/layer_0/attention/self/MatMul_1, Execution Time: 0.001378 seconds Node: bert/encoder/layer_0/attention/self/transpose_3, Execution Time: 0.000243 seconds Node: bert/encoder/layer_0/attention/self/Reshape_3, Execution Time: 0.000038 seconds Matmul Fuse Node: bert/encoder/layer_0/attention/output/dense/MatMul, Execution Time: 0.000992 seconds Node: bert/encoder/layer_0/attention/output/add, Execution Time: 0.000533 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/mean, Execution Time: 0.000266 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000666 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/SquaredDifference__309, Execution Time: 0.000837 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/variance, Execution Time: 0.000246 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000084 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/Rsqrt__311, Execution Time: 0.000088 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000078 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000076 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000076 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000648 seconds Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000673 seconds Matmul Fuse Node: bert/encoder/layer_0/intermediate/dense/MatMul, Execution Time: 0.002969 seconds Node: bert/encoder/layer_0/intermediate/dense/Pow, Execution Time: 0.017117 seconds Node: bert/encoder/layer_0/intermediate/dense/mul, Execution Time: 0.001259 seconds Node: bert/encoder/layer_0/intermediate/dense/add, Execution Time: 0.001522 seconds Node: bert/encoder/layer_0/intermediate/dense/mul_1, Execution Time: 0.001118 seconds Node: bert/encoder/layer_0/intermediate/dense/Tanh, Execution Time: 0.003483 seconds Node: bert/encoder/layer_0/intermediate/dense/add_1, Execution Time: 0.001261 seconds Node: bert/encoder/layer_0/intermediate/dense/mul_2, Execution Time: 0.001120 seconds Node: bert/encoder/layer_0/intermediate/dense/mul_3, Execution Time: 0.001540 seconds Matmul Fuse Node: bert/encoder/layer_0/output/dense/MatMul, Execution Time: 0.002585 seconds Node: bert/encoder/layer_0/output/add, Execution Time: 0.000537 seconds Node: bert/encoder/layer_0/output/LayerNorm/moments/mean, Execution Time: 0.000271 seconds Node: bert/encoder/layer_0/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000398 seconds Node: bert/encoder/layer_0/output/LayerNorm/moments/SquaredDifference__313, Execution Time: 0.000585 seconds Node: bert/encoder/layer_0/output/LayerNorm/moments/variance, Execution Time: 0.000242 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/add, Execution Time: 0.000081 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/Rsqrt__315, Execution Time: 0.000079 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul, Execution Time: 0.000081 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000076 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/sub, Execution Time: 0.000082 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000394 seconds Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000422 seconds Matmul Fuse Node: bert/encoder/layer_1/attention/self/value/MatMul, Execution Time: 0.000979 seconds Node: bert/encoder/layer_1/attention/self/Reshape_2, Execution Time: 0.000030 seconds Node: bert/encoder/layer_1/attention/self/transpose_2, Execution Time: 0.000271 seconds Matmul Fuse Node: bert/encoder/layer_1/attention/self/query/MatMul, Execution Time: 0.000941 seconds Node: bert/encoder/layer_1/attention/self/Reshape, Execution Time: 0.000012 seconds Node: bert/encoder/layer_1/attention/self/transpose, Execution Time: 0.000241 seconds Matmul Fuse Node: bert/encoder/layer_1/attention/self/key/MatMul, Execution Time: 0.000944 seconds Node: bert/encoder/layer_1/attention/self/Reshape_1, Execution Time: 0.000010 seconds Node: bert/encoder/layer_1/attention/self/MatMul__320, Execution Time: 0.000238 seconds Node: bert/encoder/layer_1/attention/self/MatMul, Execution Time: 0.001344 seconds Node: bert/encoder/layer_1/attention/self/Mul, Execution Time: 0.001151 seconds Node: bert/encoder/layer_1/attention/self/add, Execution Time: 0.001843 seconds Node: bert/encoder/layer_1/attention/self/Softmax, Execution Time: 0.001943 seconds Node: bert/encoder/layer_1/attention/self/MatMul_1, Execution Time: 0.001081 seconds Node: bert/encoder/layer_1/attention/self/transpose_3, Execution Time: 0.000238 seconds Node: bert/encoder/layer_1/attention/self/Reshape_3, Execution Time: 0.000049 seconds Matmul Fuse Node: bert/encoder/layer_1/attention/output/dense/MatMul, Execution Time: 0.000913 seconds Node: bert/encoder/layer_1/attention/output/add, Execution Time: 0.000522 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/mean, Execution Time: 0.000246 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000654 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/SquaredDifference__323, Execution Time: 0.000825 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/variance, Execution Time: 0.000246 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000081 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/Rsqrt__325, Execution Time: 0.000099 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000080 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000082 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000077 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000647 seconds Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000672 seconds Matmul Fuse Node: bert/encoder/layer_1/intermediate/dense/MatMul, Execution Time: 0.002170 seconds Node: bert/encoder/layer_1/intermediate/dense/Pow, Execution Time: 0.000716 seconds Node: bert/encoder/layer_1/intermediate/dense/mul, Execution Time: 0.001267 seconds Node: bert/encoder/layer_1/intermediate/dense/add, Execution Time: 0.001456 seconds Node: bert/encoder/layer_1/intermediate/dense/mul_1, Execution Time: 0.001209 seconds Node: bert/encoder/layer_1/intermediate/dense/Tanh, Execution Time: 0.001107 seconds Node: bert/encoder/layer_1/intermediate/dense/add_1, Execution Time: 0.001108 seconds Node: bert/encoder/layer_1/intermediate/dense/mul_2, Execution Time: 0.001175 seconds Node: bert/encoder/layer_1/intermediate/dense/mul_3, Execution Time: 0.001378 seconds Matmul Fuse Node: bert/encoder/layer_1/output/dense/MatMul, Execution Time: 0.002254 seconds Node: bert/encoder/layer_1/output/add, Execution Time: 0.000550 seconds Node: bert/encoder/layer_1/output/LayerNorm/moments/mean, Execution Time: 0.000272 seconds Node: bert/encoder/layer_1/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000429 seconds Node: bert/encoder/layer_1/output/LayerNorm/moments/SquaredDifference__327, Execution Time: 0.000584 seconds Node: bert/encoder/layer_1/output/LayerNorm/moments/variance, Execution Time: 0.000246 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/add, Execution Time: 0.000080 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/Rsqrt__329, Execution Time: 0.000081 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul, Execution Time: 0.000079 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000074 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/sub, Execution Time: 0.000080 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000430 seconds Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000435 seconds Matmul Fuse Node: bert/encoder/layer_2/attention/self/value/MatMul, Execution Time: 0.000961 seconds Node: bert/encoder/layer_2/attention/self/Reshape_2, Execution Time: 0.000030 seconds Node: bert/encoder/layer_2/attention/self/transpose_2, Execution Time: 0.000251 seconds Matmul Fuse Node: bert/encoder/layer_2/attention/self/query/MatMul, Execution Time: 0.000897 seconds Node: bert/encoder/layer_2/attention/self/Reshape, Execution Time: 0.000011 seconds Node: bert/encoder/layer_2/attention/self/transpose, Execution Time: 0.000257 seconds Matmul Fuse Node: bert/encoder/layer_2/attention/self/key/MatMul, Execution Time: 0.000860 seconds Node: bert/encoder/layer_2/attention/self/Reshape_1, Execution Time: 0.000010 seconds Node: bert/encoder/layer_2/attention/self/MatMul__334, Execution Time: 0.000252 seconds Node: bert/encoder/layer_2/attention/self/MatMul, Execution Time: 0.001302 seconds Node: bert/encoder/layer_2/attention/self/Mul, Execution Time: 0.001156 seconds Node: bert/encoder/layer_2/attention/self/add, Execution Time: 0.001884 seconds Node: bert/encoder/layer_2/attention/self/Softmax, Execution Time: 0.001996 seconds Node: bert/encoder/layer_2/attention/self/MatMul_1, Execution Time: 0.001058 seconds Node: bert/encoder/layer_2/attention/self/transpose_3, Execution Time: 0.000237 seconds Node: bert/encoder/layer_2/attention/self/Reshape_3, Execution Time: 0.000046 seconds Matmul Fuse Node: bert/encoder/layer_2/attention/output/dense/MatMul, Execution Time: 0.000787 seconds Node: bert/encoder/layer_2/attention/output/add, Execution Time: 0.000762 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/mean, Execution Time: 0.000257 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000648 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/SquaredDifference__337, Execution Time: 0.000816 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/variance, Execution Time: 0.000245 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000080 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/Rsqrt__339, Execution Time: 0.000094 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000078 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000086 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000080 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000624 seconds Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000734 seconds Matmul Fuse Node: bert/encoder/layer_2/intermediate/dense/MatMul, Execution Time: 0.002126 seconds Node: bert/encoder/layer_2/intermediate/dense/Pow, Execution Time: 0.000730 seconds Node: bert/encoder/layer_2/intermediate/dense/mul, Execution Time: 0.001158 seconds Node: bert/encoder/layer_2/intermediate/dense/add, Execution Time: 0.001405 seconds Node: bert/encoder/layer_2/intermediate/dense/mul_1, Execution Time: 0.001290 seconds Node: bert/encoder/layer_2/intermediate/dense/Tanh, Execution Time: 0.001431 seconds Node: bert/encoder/layer_2/intermediate/dense/add_1, Execution Time: 0.001561 seconds Node: bert/encoder/layer_2/intermediate/dense/mul_2, Execution Time: 0.001442 seconds Node: bert/encoder/layer_2/intermediate/dense/mul_3, Execution Time: 0.001797 seconds Matmul Fuse Node: bert/encoder/layer_2/output/dense/MatMul, Execution Time: 0.003069 seconds Node: bert/encoder/layer_2/output/add, Execution Time: 0.000561 seconds Node: bert/encoder/layer_2/output/LayerNorm/moments/mean, Execution Time: 0.000255 seconds Node: bert/encoder/layer_2/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000394 seconds Node: bert/encoder/layer_2/output/LayerNorm/moments/SquaredDifference__341, Execution Time: 0.000577 seconds Node: bert/encoder/layer_2/output/LayerNorm/moments/variance, Execution Time: 0.000247 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/add, Execution Time: 0.000087 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000060 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/Rsqrt__343, Execution Time: 0.000096 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul, Execution Time: 0.000084 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000078 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/sub, Execution Time: 0.000077 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000406 seconds Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000450 seconds Matmul Fuse Node: bert/encoder/layer_3/attention/self/value/MatMul, Execution Time: 0.000891 seconds Node: bert/encoder/layer_3/attention/self/Reshape_2, Execution Time: 0.000030 seconds Node: bert/encoder/layer_3/attention/self/transpose_2, Execution Time: 0.000248 seconds Matmul Fuse Node: bert/encoder/layer_3/attention/self/query/MatMul, Execution Time: 0.000926 seconds Node: bert/encoder/layer_3/attention/self/Reshape, Execution Time: 0.000012 seconds Node: bert/encoder/layer_3/attention/self/transpose, Execution Time: 0.000241 seconds Matmul Fuse Node: bert/encoder/layer_3/attention/self/key/MatMul, Execution Time: 0.000952 seconds Node: bert/encoder/layer_3/attention/self/Reshape_1, Execution Time: 0.000013 seconds Node: bert/encoder/layer_3/attention/self/MatMul__348, Execution Time: 0.000243 seconds Node: bert/encoder/layer_3/attention/self/MatMul, Execution Time: 0.001359 seconds Node: bert/encoder/layer_3/attention/self/Mul, Execution Time: 0.001226 seconds Node: bert/encoder/layer_3/attention/self/add, Execution Time: 0.001786 seconds Node: bert/encoder/layer_3/attention/self/Softmax, Execution Time: 0.001916 seconds Node: bert/encoder/layer_3/attention/self/MatMul_1, Execution Time: 0.001043 seconds Node: bert/encoder/layer_3/attention/self/transpose_3, Execution Time: 0.000242 seconds Node: bert/encoder/layer_3/attention/self/Reshape_3, Execution Time: 0.000042 seconds Matmul Fuse Node: bert/encoder/layer_3/attention/output/dense/MatMul, Execution Time: 0.000863 seconds Node: bert/encoder/layer_3/attention/output/add, Execution Time: 0.000504 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/mean, Execution Time: 0.000262 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000651 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/SquaredDifference__351, Execution Time: 0.000883 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/variance, Execution Time: 0.000250 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000082 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000062 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/Rsqrt__353, Execution Time: 0.000094 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000670 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000076 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000077 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000651 seconds Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000677 seconds Matmul Fuse Node: bert/encoder/layer_3/intermediate/dense/MatMul, Execution Time: 0.002263 seconds Node: bert/encoder/layer_3/intermediate/dense/Pow, Execution Time: 0.000716 seconds Node: bert/encoder/layer_3/intermediate/dense/mul, Execution Time: 0.001184 seconds Node: bert/encoder/layer_3/intermediate/dense/add, Execution Time: 0.001425 seconds Node: bert/encoder/layer_3/intermediate/dense/mul_1, Execution Time: 0.001182 seconds Node: bert/encoder/layer_3/intermediate/dense/Tanh, Execution Time: 0.001182 seconds Node: bert/encoder/layer_3/intermediate/dense/add_1, Execution Time: 0.001111 seconds Node: bert/encoder/layer_3/intermediate/dense/mul_2, Execution Time: 0.001105 seconds Node: bert/encoder/layer_3/intermediate/dense/mul_3, Execution Time: 0.001362 seconds Matmul Fuse Node: bert/encoder/layer_3/output/dense/MatMul, Execution Time: 0.002222 seconds Node: bert/encoder/layer_3/output/add, Execution Time: 0.000541 seconds Node: bert/encoder/layer_3/output/LayerNorm/moments/mean, Execution Time: 0.000259 seconds Node: bert/encoder/layer_3/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000395 seconds Node: bert/encoder/layer_3/output/LayerNorm/moments/SquaredDifference__355, Execution Time: 0.000577 seconds Node: bert/encoder/layer_3/output/LayerNorm/moments/variance, Execution Time: 0.000240 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/add, Execution Time: 0.000078 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/Rsqrt__357, Execution Time: 0.000096 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul, Execution Time: 0.000083 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000079 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/sub, Execution Time: 0.000075 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000404 seconds Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000427 seconds Matmul Fuse Node: bert/encoder/layer_4/attention/self/value/MatMul, Execution Time: 0.000966 seconds Node: bert/encoder/layer_4/attention/self/Reshape_2, Execution Time: 0.000030 seconds Node: bert/encoder/layer_4/attention/self/transpose_2, Execution Time: 0.000256 seconds Matmul Fuse Node: bert/encoder/layer_4/attention/self/query/MatMul, Execution Time: 0.000876 seconds Node: bert/encoder/layer_4/attention/self/Reshape, Execution Time: 0.000012 seconds Node: bert/encoder/layer_4/attention/self/transpose, Execution Time: 0.000244 seconds Matmul Fuse Node: bert/encoder/layer_4/attention/self/key/MatMul, Execution Time: 0.000863 seconds Node: bert/encoder/layer_4/attention/self/Reshape_1, Execution Time: 0.000011 seconds Node: bert/encoder/layer_4/attention/self/MatMul__362, Execution Time: 0.000249 seconds Node: bert/encoder/layer_4/attention/self/MatMul, Execution Time: 0.001410 seconds Node: bert/encoder/layer_4/attention/self/Mul, Execution Time: 0.001170 seconds Node: bert/encoder/layer_4/attention/self/add, Execution Time: 0.001823 seconds Node: bert/encoder/layer_4/attention/self/Softmax, Execution Time: 0.002052 seconds Node: bert/encoder/layer_4/attention/self/MatMul_1, Execution Time: 0.001053 seconds Node: bert/encoder/layer_4/attention/self/transpose_3, Execution Time: 0.000238 seconds Node: bert/encoder/layer_4/attention/self/Reshape_3, Execution Time: 0.000047 seconds Matmul Fuse Node: bert/encoder/layer_4/attention/output/dense/MatMul, Execution Time: 0.000815 seconds Node: bert/encoder/layer_4/attention/output/add, Execution Time: 0.000779 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/mean, Execution Time: 0.000261 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000685 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/SquaredDifference__365, Execution Time: 0.000861 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/variance, Execution Time: 0.000250 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000081 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/Rsqrt__367, Execution Time: 0.000085 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000079 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000074 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000076 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000643 seconds Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000708 seconds Matmul Fuse Node: bert/encoder/layer_4/intermediate/dense/MatMul, Execution Time: 0.002162 seconds Node: bert/encoder/layer_4/intermediate/dense/Pow, Execution Time: 0.000724 seconds Node: bert/encoder/layer_4/intermediate/dense/mul, Execution Time: 0.001149 seconds Node: bert/encoder/layer_4/intermediate/dense/add, Execution Time: 0.001426 seconds Node: bert/encoder/layer_4/intermediate/dense/mul_1, Execution Time: 0.001245 seconds Node: bert/encoder/layer_4/intermediate/dense/Tanh, Execution Time: 0.001097 seconds Node: bert/encoder/layer_4/intermediate/dense/add_1, Execution Time: 0.001118 seconds Node: bert/encoder/layer_4/intermediate/dense/mul_2, Execution Time: 0.001105 seconds Node: bert/encoder/layer_4/intermediate/dense/mul_3, Execution Time: 0.001387 seconds Matmul Fuse Node: bert/encoder/layer_4/output/dense/MatMul, Execution Time: 0.002260 seconds Node: bert/encoder/layer_4/output/add, Execution Time: 0.000531 seconds Node: bert/encoder/layer_4/output/LayerNorm/moments/mean, Execution Time: 0.000268 seconds Node: bert/encoder/layer_4/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000403 seconds Node: bert/encoder/layer_4/output/LayerNorm/moments/SquaredDifference__369, Execution Time: 0.000587 seconds Node: bert/encoder/layer_4/output/LayerNorm/moments/variance, Execution Time: 0.000244 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/add, Execution Time: 0.000078 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000062 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/Rsqrt__371, Execution Time: 0.000083 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul, Execution Time: 0.000081 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000073 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/sub, Execution Time: 0.000075 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000410 seconds Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000440 seconds Matmul Fuse Node: bert/encoder/layer_5/attention/self/value/MatMul, Execution Time: 0.001017 seconds Node: bert/encoder/layer_5/attention/self/Reshape_2, Execution Time: 0.000029 seconds Node: bert/encoder/layer_5/attention/self/transpose_2, Execution Time: 0.000257 seconds Matmul Fuse Node: bert/encoder/layer_5/attention/self/query/MatMul, Execution Time: 0.000955 seconds Node: bert/encoder/layer_5/attention/self/Reshape, Execution Time: 0.000012 seconds Node: bert/encoder/layer_5/attention/self/transpose, Execution Time: 0.000241 seconds Matmul Fuse Node: bert/encoder/layer_5/attention/self/key/MatMul, Execution Time: 0.000877 seconds Node: bert/encoder/layer_5/attention/self/Reshape_1, Execution Time: 0.000011 seconds Node: bert/encoder/layer_5/attention/self/MatMul__376, Execution Time: 0.000236 seconds Node: bert/encoder/layer_5/attention/self/MatMul, Execution Time: 0.001345 seconds Node: bert/encoder/layer_5/attention/self/Mul, Execution Time: 0.001199 seconds Node: bert/encoder/layer_5/attention/self/add, Execution Time: 0.001823 seconds Node: bert/encoder/layer_5/attention/self/Softmax, Execution Time: 0.002017 seconds Node: bert/encoder/layer_5/attention/self/MatMul_1, Execution Time: 0.001077 seconds Node: bert/encoder/layer_5/attention/self/transpose_3, Execution Time: 0.000234 seconds Node: bert/encoder/layer_5/attention/self/Reshape_3, Execution Time: 0.000038 seconds Matmul Fuse Node: bert/encoder/layer_5/attention/output/dense/MatMul, Execution Time: 0.000863 seconds Node: bert/encoder/layer_5/attention/output/add, Execution Time: 0.000516 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/mean, Execution Time: 0.000257 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000635 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/SquaredDifference__379, Execution Time: 0.000821 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/variance, Execution Time: 0.000247 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000089 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/Rsqrt__381, Execution Time: 0.000094 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000086 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000083 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000076 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000639 seconds Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000662 seconds Matmul Fuse Node: bert/encoder/layer_5/intermediate/dense/MatMul, Execution Time: 0.002409 seconds Node: bert/encoder/layer_5/intermediate/dense/Pow, Execution Time: 0.001011 seconds Node: bert/encoder/layer_5/intermediate/dense/mul, Execution Time: 0.001540 seconds Node: bert/encoder/layer_5/intermediate/dense/add, Execution Time: 0.001941 seconds Node: bert/encoder/layer_5/intermediate/dense/mul_1, Execution Time: 0.001457 seconds Node: bert/encoder/layer_5/intermediate/dense/Tanh, Execution Time: 0.001441 seconds Node: bert/encoder/layer_5/intermediate/dense/add_1, Execution Time: 0.001222 seconds Node: bert/encoder/layer_5/intermediate/dense/mul_2, Execution Time: 0.001118 seconds Node: bert/encoder/layer_5/intermediate/dense/mul_3, Execution Time: 0.001469 seconds Matmul Fuse Node: bert/encoder/layer_5/output/dense/MatMul, Execution Time: 0.002431 seconds Node: bert/encoder/layer_5/output/add, Execution Time: 0.000553 seconds Node: bert/encoder/layer_5/output/LayerNorm/moments/mean, Execution Time: 0.000255 seconds Node: bert/encoder/layer_5/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000404 seconds Node: bert/encoder/layer_5/output/LayerNorm/moments/SquaredDifference__383, Execution Time: 0.000570 seconds Node: bert/encoder/layer_5/output/LayerNorm/moments/variance, Execution Time: 0.000236 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/add, Execution Time: 0.000088 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/Rsqrt__385, Execution Time: 0.000079 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul, Execution Time: 0.000078 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000073 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/sub, Execution Time: 0.000075 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000391 seconds Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000431 seconds Matmul Fuse Node: bert/encoder/layer_6/attention/self/value/MatMul, Execution Time: 0.000947 seconds Node: bert/encoder/layer_6/attention/self/Reshape_2, Execution Time: 0.000030 seconds Node: bert/encoder/layer_6/attention/self/transpose_2, Execution Time: 0.000251 seconds Matmul Fuse Node: bert/encoder/layer_6/attention/self/query/MatMul, Execution Time: 0.000890 seconds Node: bert/encoder/layer_6/attention/self/Reshape, Execution Time: 0.000011 seconds Node: bert/encoder/layer_6/attention/self/transpose, Execution Time: 0.000237 seconds Matmul Fuse Node: bert/encoder/layer_6/attention/self/key/MatMul, Execution Time: 0.000838 seconds Node: bert/encoder/layer_6/attention/self/Reshape_1, Execution Time: 0.000011 seconds Node: bert/encoder/layer_6/attention/self/MatMul__390, Execution Time: 0.000237 seconds Node: bert/encoder/layer_6/attention/self/MatMul, Execution Time: 0.001312 seconds Node: bert/encoder/layer_6/attention/self/Mul, Execution Time: 0.001154 seconds Node: bert/encoder/layer_6/attention/self/add, Execution Time: 0.001883 seconds Node: bert/encoder/layer_6/attention/self/Softmax, Execution Time: 0.001981 seconds Node: bert/encoder/layer_6/attention/self/MatMul_1, Execution Time: 0.001039 seconds Node: bert/encoder/layer_6/attention/self/transpose_3, Execution Time: 0.000237 seconds Node: bert/encoder/layer_6/attention/self/Reshape_3, Execution Time: 0.000043 seconds Matmul Fuse Node: bert/encoder/layer_6/attention/output/dense/MatMul, Execution Time: 0.000844 seconds Node: bert/encoder/layer_6/attention/output/add, Execution Time: 0.000505 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/mean, Execution Time: 0.000263 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000650 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/SquaredDifference__393, Execution Time: 0.000814 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/variance, Execution Time: 0.000249 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000080 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000057 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/Rsqrt__395, Execution Time: 0.000082 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000077 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000073 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000077 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000641 seconds Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000702 seconds Matmul Fuse Node: bert/encoder/layer_6/intermediate/dense/MatMul, Execution Time: 0.002149 seconds Node: bert/encoder/layer_6/intermediate/dense/Pow, Execution Time: 0.000701 seconds Node: bert/encoder/layer_6/intermediate/dense/mul, Execution Time: 0.001266 seconds Node: bert/encoder/layer_6/intermediate/dense/add, Execution Time: 0.001434 seconds Node: bert/encoder/layer_6/intermediate/dense/mul_1, Execution Time: 0.001154 seconds Node: bert/encoder/layer_6/intermediate/dense/Tanh, Execution Time: 0.001097 seconds Node: bert/encoder/layer_6/intermediate/dense/add_1, Execution Time: 0.001094 seconds Node: bert/encoder/layer_6/intermediate/dense/mul_2, Execution Time: 0.001168 seconds Node: bert/encoder/layer_6/intermediate/dense/mul_3, Execution Time: 0.001379 seconds Matmul Fuse Node: bert/encoder/layer_6/output/dense/MatMul, Execution Time: 0.002216 seconds Node: bert/encoder/layer_6/output/add, Execution Time: 0.000517 seconds Node: bert/encoder/layer_6/output/LayerNorm/moments/mean, Execution Time: 0.000263 seconds Node: bert/encoder/layer_6/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000394 seconds Node: bert/encoder/layer_6/output/LayerNorm/moments/SquaredDifference__397, Execution Time: 0.000577 seconds Node: bert/encoder/layer_6/output/LayerNorm/moments/variance, Execution Time: 0.000231 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/add, Execution Time: 0.000081 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000057 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/Rsqrt__399, Execution Time: 0.000083 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul, Execution Time: 0.000077 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000073 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/sub, Execution Time: 0.000074 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000391 seconds Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000430 seconds Matmul Fuse Node: bert/encoder/layer_7/attention/self/value/MatMul, Execution Time: 0.000869 seconds Node: bert/encoder/layer_7/attention/self/Reshape_2, Execution Time: 0.000029 seconds Node: bert/encoder/layer_7/attention/self/transpose_2, Execution Time: 0.000248 seconds Matmul Fuse Node: bert/encoder/layer_7/attention/self/query/MatMul, Execution Time: 0.000913 seconds Node: bert/encoder/layer_7/attention/self/Reshape, Execution Time: 0.000013 seconds Node: bert/encoder/layer_7/attention/self/transpose, Execution Time: 0.000247 seconds Matmul Fuse Node: bert/encoder/layer_7/attention/self/key/MatMul, Execution Time: 0.000906 seconds Node: bert/encoder/layer_7/attention/self/Reshape_1, Execution Time: 0.000010 seconds Node: bert/encoder/layer_7/attention/self/MatMul__404, Execution Time: 0.000236 seconds Node: bert/encoder/layer_7/attention/self/MatMul, Execution Time: 0.001341 seconds Node: bert/encoder/layer_7/attention/self/Mul, Execution Time: 0.001182 seconds Node: bert/encoder/layer_7/attention/self/add, Execution Time: 0.001925 seconds Node: bert/encoder/layer_7/attention/self/Softmax, Execution Time: 0.001996 seconds Node: bert/encoder/layer_7/attention/self/MatMul_1, Execution Time: 0.001013 seconds Node: bert/encoder/layer_7/attention/self/transpose_3, Execution Time: 0.000249 seconds Node: bert/encoder/layer_7/attention/self/Reshape_3, Execution Time: 0.000044 seconds Matmul Fuse Node: bert/encoder/layer_7/attention/output/dense/MatMul, Execution Time: 0.000852 seconds Node: bert/encoder/layer_7/attention/output/add, Execution Time: 0.000520 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/mean, Execution Time: 0.000259 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000681 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/SquaredDifference__407, Execution Time: 0.000814 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/variance, Execution Time: 0.000247 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000085 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000060 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/Rsqrt__409, Execution Time: 0.000082 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000082 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000076 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000076 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000640 seconds Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000743 seconds Matmul Fuse Node: bert/encoder/layer_7/intermediate/dense/MatMul, Execution Time: 0.002125 seconds Node: bert/encoder/layer_7/intermediate/dense/Pow, Execution Time: 0.000731 seconds Node: bert/encoder/layer_7/intermediate/dense/mul, Execution Time: 0.001143 seconds Node: bert/encoder/layer_7/intermediate/dense/add, Execution Time: 0.001405 seconds Node: bert/encoder/layer_7/intermediate/dense/mul_1, Execution Time: 0.001138 seconds Node: bert/encoder/layer_7/intermediate/dense/Tanh, Execution Time: 0.001124 seconds Node: bert/encoder/layer_7/intermediate/dense/add_1, Execution Time: 0.001179 seconds Node: bert/encoder/layer_7/intermediate/dense/mul_2, Execution Time: 0.001122 seconds Node: bert/encoder/layer_7/intermediate/dense/mul_3, Execution Time: 0.001384 seconds Matmul Fuse Node: bert/encoder/layer_7/output/dense/MatMul, Execution Time: 0.002280 seconds Node: bert/encoder/layer_7/output/add, Execution Time: 0.000536 seconds Node: bert/encoder/layer_7/output/LayerNorm/moments/mean, Execution Time: 0.000250 seconds Node: bert/encoder/layer_7/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000410 seconds Node: bert/encoder/layer_7/output/LayerNorm/moments/SquaredDifference__411, Execution Time: 0.000576 seconds Node: bert/encoder/layer_7/output/LayerNorm/moments/variance, Execution Time: 0.000238 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/add, Execution Time: 0.000079 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000062 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/Rsqrt__413, Execution Time: 0.000083 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul, Execution Time: 0.000077 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000079 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/sub, Execution Time: 0.000077 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000390 seconds Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000434 seconds Matmul Fuse Node: bert/encoder/layer_8/attention/self/value/MatMul, Execution Time: 0.000887 seconds Node: bert/encoder/layer_8/attention/self/Reshape_2, Execution Time: 0.000031 seconds Node: bert/encoder/layer_8/attention/self/transpose_2, Execution Time: 0.000249 seconds Matmul Fuse Node: bert/encoder/layer_8/attention/self/query/MatMul, Execution Time: 0.000911 seconds Node: bert/encoder/layer_8/attention/self/Reshape, Execution Time: 0.000013 seconds Node: bert/encoder/layer_8/attention/self/transpose, Execution Time: 0.000241 seconds Matmul Fuse Node: bert/encoder/layer_8/attention/self/key/MatMul, Execution Time: 0.000892 seconds Node: bert/encoder/layer_8/attention/self/Reshape_1, Execution Time: 0.000010 seconds Node: bert/encoder/layer_8/attention/self/MatMul__418, Execution Time: 0.000237 seconds Node: bert/encoder/layer_8/attention/self/MatMul, Execution Time: 0.001361 seconds Node: bert/encoder/layer_8/attention/self/Mul, Execution Time: 0.001233 seconds Node: bert/encoder/layer_8/attention/self/add, Execution Time: 0.001777 seconds Node: bert/encoder/layer_8/attention/self/Softmax, Execution Time: 0.001938 seconds Node: bert/encoder/layer_8/attention/self/MatMul_1, Execution Time: 0.001018 seconds Node: bert/encoder/layer_8/attention/self/transpose_3, Execution Time: 0.000237 seconds Node: bert/encoder/layer_8/attention/self/Reshape_3, Execution Time: 0.000056 seconds Matmul Fuse Node: bert/encoder/layer_8/attention/output/dense/MatMul, Execution Time: 0.000851 seconds Node: bert/encoder/layer_8/attention/output/add, Execution Time: 0.000511 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/mean, Execution Time: 0.000256 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000648 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/SquaredDifference__421, Execution Time: 0.000886 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/variance, Execution Time: 0.000244 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000080 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000057 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/Rsqrt__423, Execution Time: 0.000095 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000085 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000074 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000074 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000639 seconds Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000670 seconds Matmul Fuse Node: bert/encoder/layer_8/intermediate/dense/MatMul, Execution Time: 0.002197 seconds Node: bert/encoder/layer_8/intermediate/dense/Pow, Execution Time: 0.000722 seconds Node: bert/encoder/layer_8/intermediate/dense/mul, Execution Time: 0.001163 seconds Node: bert/encoder/layer_8/intermediate/dense/add, Execution Time: 0.001443 seconds Node: bert/encoder/layer_8/intermediate/dense/mul_1, Execution Time: 0.001161 seconds Node: bert/encoder/layer_8/intermediate/dense/Tanh, Execution Time: 0.001209 seconds Node: bert/encoder/layer_8/intermediate/dense/add_1, Execution Time: 0.001138 seconds Node: bert/encoder/layer_8/intermediate/dense/mul_2, Execution Time: 0.001146 seconds Node: bert/encoder/layer_8/intermediate/dense/mul_3, Execution Time: 0.001369 seconds Matmul Fuse Node: bert/encoder/layer_8/output/dense/MatMul, Execution Time: 0.002232 seconds Node: bert/encoder/layer_8/output/add, Execution Time: 0.000535 seconds Node: bert/encoder/layer_8/output/LayerNorm/moments/mean, Execution Time: 0.000262 seconds Node: bert/encoder/layer_8/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000397 seconds Node: bert/encoder/layer_8/output/LayerNorm/moments/SquaredDifference__425, Execution Time: 0.000572 seconds Node: bert/encoder/layer_8/output/LayerNorm/moments/variance, Execution Time: 0.000247 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/add, Execution Time: 0.000079 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000056 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/Rsqrt__427, Execution Time: 0.000095 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul, Execution Time: 0.000077 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000078 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/sub, Execution Time: 0.000076 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000392 seconds Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000445 seconds Matmul Fuse Node: bert/encoder/layer_9/attention/self/value/MatMul, Execution Time: 0.000955 seconds Node: bert/encoder/layer_9/attention/self/Reshape_2, Execution Time: 0.000030 seconds Node: bert/encoder/layer_9/attention/self/transpose_2, Execution Time: 0.000259 seconds Matmul Fuse Node: bert/encoder/layer_9/attention/self/query/MatMul, Execution Time: 0.000921 seconds Node: bert/encoder/layer_9/attention/self/Reshape, Execution Time: 0.000012 seconds Node: bert/encoder/layer_9/attention/self/transpose, Execution Time: 0.000247 seconds Matmul Fuse Node: bert/encoder/layer_9/attention/self/key/MatMul, Execution Time: 0.000837 seconds Node: bert/encoder/layer_9/attention/self/Reshape_1, Execution Time: 0.000010 seconds Node: bert/encoder/layer_9/attention/self/MatMul__432, Execution Time: 0.000234 seconds Node: bert/encoder/layer_9/attention/self/MatMul, Execution Time: 0.001383 seconds Node: bert/encoder/layer_9/attention/self/Mul, Execution Time: 0.001153 seconds Node: bert/encoder/layer_9/attention/self/add, Execution Time: 0.001811 seconds Node: bert/encoder/layer_9/attention/self/Softmax, Execution Time: 0.001949 seconds Node: bert/encoder/layer_9/attention/self/MatMul_1, Execution Time: 0.000996 seconds Node: bert/encoder/layer_9/attention/self/transpose_3, Execution Time: 0.000236 seconds Node: bert/encoder/layer_9/attention/self/Reshape_3, Execution Time: 0.000046 seconds Matmul Fuse Node: bert/encoder/layer_9/attention/output/dense/MatMul, Execution Time: 0.000774 seconds Node: bert/encoder/layer_9/attention/output/add, Execution Time: 0.000510 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/mean, Execution Time: 0.000261 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000752 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/SquaredDifference__435, Execution Time: 0.000857 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/variance, Execution Time: 0.000249 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000080 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000057 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/Rsqrt__437, Execution Time: 0.000094 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000076 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000072 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000080 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000654 seconds Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000682 seconds Matmul Fuse Node: bert/encoder/layer_9/intermediate/dense/MatMul, Execution Time: 0.002082 seconds Node: bert/encoder/layer_9/intermediate/dense/Pow, Execution Time: 0.000714 seconds Node: bert/encoder/layer_9/intermediate/dense/mul, Execution Time: 0.001174 seconds Node: bert/encoder/layer_9/intermediate/dense/add, Execution Time: 0.001412 seconds Node: bert/encoder/layer_9/intermediate/dense/mul_1, Execution Time: 0.001210 seconds Node: bert/encoder/layer_9/intermediate/dense/Tanh, Execution Time: 0.001101 seconds Node: bert/encoder/layer_9/intermediate/dense/add_1, Execution Time: 0.001101 seconds Node: bert/encoder/layer_9/intermediate/dense/mul_2, Execution Time: 0.001109 seconds Node: bert/encoder/layer_9/intermediate/dense/mul_3, Execution Time: 0.001390 seconds Matmul Fuse Node: bert/encoder/layer_9/output/dense/MatMul, Execution Time: 0.002268 seconds Node: bert/encoder/layer_9/output/add, Execution Time: 0.000522 seconds Node: bert/encoder/layer_9/output/LayerNorm/moments/mean, Execution Time: 0.000264 seconds Node: bert/encoder/layer_9/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000392 seconds Node: bert/encoder/layer_9/output/LayerNorm/moments/SquaredDifference__439, Execution Time: 0.000566 seconds Node: bert/encoder/layer_9/output/LayerNorm/moments/variance, Execution Time: 0.000239 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/add, Execution Time: 0.000077 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000061 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/Rsqrt__441, Execution Time: 0.000080 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul, Execution Time: 0.000142 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000082 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/sub, Execution Time: 0.000082 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000385 seconds Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000428 seconds Matmul Fuse Node: bert/encoder/layer_10/attention/self/value/MatMul, Execution Time: 0.000924 seconds Node: bert/encoder/layer_10/attention/self/Reshape_2, Execution Time: 0.000031 seconds Node: bert/encoder/layer_10/attention/self/transpose_2, Execution Time: 0.000250 seconds Matmul Fuse Node: bert/encoder/layer_10/attention/self/query/MatMul, Execution Time: 0.000839 seconds Node: bert/encoder/layer_10/attention/self/Reshape, Execution Time: 0.000012 seconds Node: bert/encoder/layer_10/attention/self/transpose, Execution Time: 0.000239 seconds Matmul Fuse Node: bert/encoder/layer_10/attention/self/key/MatMul, Execution Time: 0.000851 seconds Node: bert/encoder/layer_10/attention/self/Reshape_1, Execution Time: 0.000011 seconds Node: bert/encoder/layer_10/attention/self/MatMul__446, Execution Time: 0.000241 seconds Node: bert/encoder/layer_10/attention/self/MatMul, Execution Time: 0.001408 seconds Node: bert/encoder/layer_10/attention/self/Mul, Execution Time: 0.001191 seconds Node: bert/encoder/layer_10/attention/self/add, Execution Time: 0.001866 seconds Node: bert/encoder/layer_10/attention/self/Softmax, Execution Time: 0.002041 seconds Node: bert/encoder/layer_10/attention/self/MatMul_1, Execution Time: 0.001023 seconds Node: bert/encoder/layer_10/attention/self/transpose_3, Execution Time: 0.000241 seconds Node: bert/encoder/layer_10/attention/self/Reshape_3, Execution Time: 0.000044 seconds Matmul Fuse Node: bert/encoder/layer_10/attention/output/dense/MatMul, Execution Time: 0.000888 seconds Node: bert/encoder/layer_10/attention/output/add, Execution Time: 0.000506 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/mean, Execution Time: 0.000256 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000652 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/SquaredDifference__449, Execution Time: 0.000844 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/variance, Execution Time: 0.000247 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000087 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/Rsqrt__451, Execution Time: 0.000094 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000079 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000099 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000103 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000807 seconds Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000877 seconds Matmul Fuse Node: bert/encoder/layer_10/intermediate/dense/MatMul, Execution Time: 0.003381 seconds Node: bert/encoder/layer_10/intermediate/dense/Pow, Execution Time: 0.001021 seconds Node: bert/encoder/layer_10/intermediate/dense/mul, Execution Time: 0.001519 seconds Node: bert/encoder/layer_10/intermediate/dense/add, Execution Time: 0.001675 seconds Node: bert/encoder/layer_10/intermediate/dense/mul_1, Execution Time: 0.001101 seconds Node: bert/encoder/layer_10/intermediate/dense/Tanh, Execution Time: 0.001068 seconds Node: bert/encoder/layer_10/intermediate/dense/add_1, Execution Time: 0.001121 seconds Node: bert/encoder/layer_10/intermediate/dense/mul_2, Execution Time: 0.001128 seconds Node: bert/encoder/layer_10/intermediate/dense/mul_3, Execution Time: 0.001402 seconds Matmul Fuse Node: bert/encoder/layer_10/output/dense/MatMul, Execution Time: 0.002426 seconds Node: bert/encoder/layer_10/output/add, Execution Time: 0.000521 seconds Node: bert/encoder/layer_10/output/LayerNorm/moments/mean, Execution Time: 0.000258 seconds Node: bert/encoder/layer_10/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000397 seconds Node: bert/encoder/layer_10/output/LayerNorm/moments/SquaredDifference__453, Execution Time: 0.000567 seconds Node: bert/encoder/layer_10/output/LayerNorm/moments/variance, Execution Time: 0.000243 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/add, Execution Time: 0.000080 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/Rsqrt__455, Execution Time: 0.000078 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul, Execution Time: 0.000080 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000075 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/sub, Execution Time: 0.000075 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000402 seconds Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000422 seconds Matmul Fuse Node: bert/encoder/layer_11/attention/self/value/MatMul, Execution Time: 0.000923 seconds Node: bert/encoder/layer_11/attention/self/Reshape_2, Execution Time: 0.000028 seconds Node: bert/encoder/layer_11/attention/self/transpose_2, Execution Time: 0.000249 seconds Matmul Fuse Node: bert/encoder/layer_11/attention/self/query/MatMul, Execution Time: 0.000881 seconds Node: bert/encoder/layer_11/attention/self/Reshape, Execution Time: 0.000012 seconds Node: bert/encoder/layer_11/attention/self/transpose, Execution Time: 0.000237 seconds Matmul Fuse Node: bert/encoder/layer_11/attention/self/key/MatMul, Execution Time: 0.000829 seconds Node: bert/encoder/layer_11/attention/self/Reshape_1, Execution Time: 0.000010 seconds Node: bert/encoder/layer_11/attention/self/MatMul__460, Execution Time: 0.000235 seconds Node: bert/encoder/layer_11/attention/self/MatMul, Execution Time: 0.001580 seconds Node: bert/encoder/layer_11/attention/self/Mul, Execution Time: 0.001416 seconds Node: bert/encoder/layer_11/attention/self/add, Execution Time: 0.002340 seconds Node: bert/encoder/layer_11/attention/self/Softmax, Execution Time: 0.002381 seconds Node: bert/encoder/layer_11/attention/self/MatMul_1, Execution Time: 0.001252 seconds Node: bert/encoder/layer_11/attention/self/transpose_3, Execution Time: 0.000252 seconds Node: bert/encoder/layer_11/attention/self/Reshape_3, Execution Time: 0.000061 seconds Matmul Fuse Node: bert/encoder/layer_11/attention/output/dense/MatMul, Execution Time: 0.000941 seconds Node: bert/encoder/layer_11/attention/output/add, Execution Time: 0.000539 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/mean, Execution Time: 0.000278 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000714 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/SquaredDifference__463, Execution Time: 0.000885 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/variance, Execution Time: 0.000258 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000091 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000066 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/Rsqrt__465, Execution Time: 0.000091 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000091 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000086 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000083 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000724 seconds Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000757 seconds Matmul Fuse Node: bert/encoder/layer_11/intermediate/dense/MatMul, Execution Time: 0.002280 seconds Node: bert/encoder/layer_11/intermediate/dense/Pow, Execution Time: 0.000732 seconds Node: bert/encoder/layer_11/intermediate/dense/mul, Execution Time: 0.001313 seconds Node: bert/encoder/layer_11/intermediate/dense/add, Execution Time: 0.001567 seconds Node: bert/encoder/layer_11/intermediate/dense/mul_1, Execution Time: 0.001288 seconds Node: bert/encoder/layer_11/intermediate/dense/Tanh, Execution Time: 0.001281 seconds Node: bert/encoder/layer_11/intermediate/dense/add_1, Execution Time: 0.001367 seconds Node: bert/encoder/layer_11/intermediate/dense/mul_2, Execution Time: 0.001282 seconds Node: bert/encoder/layer_11/intermediate/dense/mul_3, Execution Time: 0.001544 seconds Matmul Fuse Node: bert/encoder/layer_11/output/dense/MatMul, Execution Time: 0.002792 seconds Node: bert/encoder/layer_11/output/add, Execution Time: 0.000551 seconds Node: bert/encoder/layer_11/output/LayerNorm/moments/mean, Execution Time: 0.000267 seconds Node: bert/encoder/layer_11/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000418 seconds Node: bert/encoder/layer_11/output/LayerNorm/moments/SquaredDifference__467, Execution Time: 0.000600 seconds Node: bert/encoder/layer_11/output/LayerNorm/moments/variance, Execution Time: 0.000250 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/add, Execution Time: 0.000090 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000063 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/Rsqrt__469, Execution Time: 0.000088 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul, Execution Time: 0.000099 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000088 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/sub, Execution Time: 0.000084 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000406 seconds Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000442 seconds Matmul Fuse Node: MatMul, Execution Time: 0.011946 seconds Node: Reshape_1, Execution Time: 0.000037 seconds Node: transpose, Execution Time: 0.000123 seconds Node: unstack, Execution Time: 0.000074 seconds Node: unstack__490, Execution Time: 0.000006 seconds Node: unstack__488, Execution Time: 0.000008 seconds Total Execution Time: 0.818612 seconds Total Matmul Fuse Execution Time: 0.113474 seconds Execution complete. Total execution time: 0.822080 seconds
Editor is loading...
Leave a Comment