Untitled

Node Execution Times:
Node: unique_ids_graph_outputs_Identity__10, Execution Time: 0.000005 seconds
Node: bert/encoder/Shape, Execution Time: 0.000003 seconds
Node: bert/encoder/Shape__12, Execution Time: 0.000010 seconds
Node: bert/encoder/strided_slice, Execution Time: 0.000064 seconds
Node: bert/encoder/strided_slice__16, Execution Time: 0.000005 seconds
Node: bert/encoder/strided_slice__17, Execution Time: 0.000005 seconds
Node: bert/encoder/ones/packed_Unsqueeze__18, Execution Time: 0.000010 seconds
Node: bert/encoder/ones/packed_Concat__21, Execution Time: 0.000011 seconds
Node: bert/encoder/ones__22, Execution Time: 0.000004 seconds
Node: bert/encoder/ones, Execution Time: 0.000010 seconds
Node: bert/encoder/Reshape, Execution Time: 0.000006 seconds
Node: bert/encoder/Cast, Execution Time: 0.000004 seconds
Node: bert/encoder/mul, Execution Time: 0.256233 seconds
Node: bert/encoder/layer_9/attention/self/ExpandDims, Execution Time: 0.000039 seconds
Node: bert/encoder/layer_9/attention/self/sub, Execution Time: 0.006570 seconds
Node: bert/encoder/layer_9/attention/self/mul_1, Execution Time: 0.000348 seconds
Node: bert/embeddings/Reshape_2, Execution Time: 0.000029 seconds
Node: bert/embeddings/Reshape, Execution Time: 0.000005 seconds
Node: bert/embeddings/GatherV2, Execution Time: 0.000251 seconds
Node: bert/embeddings/Reshape_1, Execution Time: 0.000006 seconds
Node: bert/embeddings/one_hot, Execution Time: 0.000063 seconds
Node: bert/embeddings/MatMul, Execution Time: 0.060043 seconds
Node: bert/embeddings/Reshape_3, Execution Time: 0.000038 seconds
Node: bert/embeddings/add, Execution Time: 0.002223 seconds
Node: bert/embeddings/add_1, Execution Time: 0.001039 seconds
Node: bert/embeddings/LayerNorm/moments/mean, Execution Time: 0.005310 seconds
Node: bert/embeddings/LayerNorm/moments/SquaredDifference, Execution Time: 0.000707 seconds
Node: bert/embeddings/LayerNorm/moments/SquaredDifference__72, Execution Time: 0.000839 seconds
Node: bert/embeddings/LayerNorm/moments/variance, Execution Time: 0.000269 seconds
Node: bert/embeddings/LayerNorm/batchnorm/add, Execution Time: 0.000086 seconds
Node: bert/embeddings/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.010999 seconds
Node: bert/embeddings/LayerNorm/batchnorm/Rsqrt__74, Execution Time: 0.005742 seconds
Node: bert/embeddings/LayerNorm/batchnorm/mul, Execution Time: 0.000117 seconds
Node: bert/embeddings/LayerNorm/batchnorm/mul_2, Execution Time: 0.000078 seconds
Node: bert/embeddings/LayerNorm/batchnorm/sub, Execution Time: 0.000086 seconds
Node: bert/embeddings/LayerNorm/batchnorm/mul_1, Execution Time: 0.000709 seconds
Node: bert/embeddings/LayerNorm/batchnorm/add_1, Execution Time: 0.000781 seconds
Node: bert/encoder/Reshape_1, Execution Time: 0.000035 seconds
Matmul Fuse Node: bert/encoder/layer_0/attention/self/value/MatMul, Execution Time: 0.002150 seconds
Node: bert/encoder/layer_0/attention/self/Reshape_2, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_0/attention/self/transpose_2, Execution Time: 0.000303 seconds
Matmul Fuse Node: bert/encoder/layer_0/attention/self/query/MatMul, Execution Time: 0.001089 seconds
Node: bert/encoder/layer_0/attention/self/Reshape, Execution Time: 0.000011 seconds
Node: bert/encoder/layer_0/attention/self/transpose, Execution Time: 0.000242 seconds
Matmul Fuse Node: bert/encoder/layer_0/attention/self/key/MatMul, Execution Time: 0.001177 seconds
Node: bert/encoder/layer_0/attention/self/Reshape_1, Execution Time: 0.000011 seconds
Node: bert/encoder/layer_0/attention/self/MatMul__306, Execution Time: 0.000240 seconds
Node: bert/encoder/layer_0/attention/self/MatMul, Execution Time: 0.004674 seconds
Node: bert/encoder/layer_0/attention/self/Mul, Execution Time: 0.001268 seconds
Node: bert/encoder/layer_0/attention/self/add, Execution Time: 0.002067 seconds
Node: bert/encoder/layer_0/attention/self/Softmax, Execution Time: 0.009916 seconds
Node: bert/encoder/layer_0/attention/self/MatMul_1, Execution Time: 0.001686 seconds
Node: bert/encoder/layer_0/attention/self/transpose_3, Execution Time: 0.000249 seconds
Node: bert/encoder/layer_0/attention/self/Reshape_3, Execution Time: 0.000037 seconds
Matmul Fuse Node: bert/encoder/layer_0/attention/output/dense/MatMul, Execution Time: 0.001325 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/mean, Execution Time: 0.000210 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000249 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/SquaredDifference__309, Execution Time: 0.000531 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/variance, Execution Time: 0.000187 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000130 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000094 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/Rsqrt__311, Execution Time: 0.000128 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000117 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000076 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000078 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000673 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000728 seconds
Matmul Fuse Node: bert/encoder/layer_0/intermediate/dense/MatMul, Execution Time: 0.003199 seconds
Node: bert/encoder/layer_0/intermediate/dense/Pow, Execution Time: 0.017842 seconds
Node: bert/encoder/layer_0/intermediate/dense/mul, Execution Time: 0.001210 seconds
Node: bert/encoder/layer_0/intermediate/dense/add, Execution Time: 0.001471 seconds
Node: bert/encoder/layer_0/intermediate/dense/mul_1, Execution Time: 0.001151 seconds
Node: bert/encoder/layer_0/intermediate/dense/Tanh, Execution Time: 0.004821 seconds
Node: bert/encoder/layer_0/intermediate/dense/add_1, Execution Time: 0.001387 seconds
Node: bert/encoder/layer_0/intermediate/dense/mul_2, Execution Time: 0.001178 seconds
Node: bert/encoder/layer_0/intermediate/dense/mul_3, Execution Time: 0.001497 seconds
Matmul Fuse Node: bert/encoder/layer_0/output/dense/MatMul, Execution Time: 0.003252 seconds
Node: bert/encoder/layer_0/output/LayerNorm/moments/mean, Execution Time: 0.000188 seconds
Node: bert/encoder/layer_0/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000256 seconds
Node: bert/encoder/layer_0/output/LayerNorm/moments/SquaredDifference__313, Execution Time: 0.000349 seconds
Node: bert/encoder/layer_0/output/LayerNorm/moments/variance, Execution Time: 0.000166 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/add, Execution Time: 0.000087 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000064 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/Rsqrt__315, Execution Time: 0.000101 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul, Execution Time: 0.000091 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000085 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/sub, Execution Time: 0.000093 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000331 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000460 seconds
Matmul Fuse Node: bert/encoder/layer_1/attention/self/value/MatMul, Execution Time: 0.001166 seconds
Node: bert/encoder/layer_1/attention/self/Reshape_2, Execution Time: 0.000034 seconds
Node: bert/encoder/layer_1/attention/self/transpose_2, Execution Time: 0.000256 seconds
Matmul Fuse Node: bert/encoder/layer_1/attention/self/query/MatMul, Execution Time: 0.001216 seconds
Node: bert/encoder/layer_1/attention/self/Reshape, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_1/attention/self/transpose, Execution Time: 0.000246 seconds
Matmul Fuse Node: bert/encoder/layer_1/attention/self/key/MatMul, Execution Time: 0.001175 seconds
Node: bert/encoder/layer_1/attention/self/Reshape_1, Execution Time: 0.000011 seconds
Node: bert/encoder/layer_1/attention/self/MatMul__320, Execution Time: 0.000243 seconds
Node: bert/encoder/layer_1/attention/self/MatMul, Execution Time: 0.001494 seconds
Node: bert/encoder/layer_1/attention/self/Mul, Execution Time: 0.001345 seconds
Node: bert/encoder/layer_1/attention/self/add, Execution Time: 0.001904 seconds
Node: bert/encoder/layer_1/attention/self/Softmax, Execution Time: 0.002000 seconds
Node: bert/encoder/layer_1/attention/self/MatMul_1, Execution Time: 0.001112 seconds
Node: bert/encoder/layer_1/attention/self/transpose_3, Execution Time: 0.000245 seconds
Node: bert/encoder/layer_1/attention/self/Reshape_3, Execution Time: 0.000043 seconds
Matmul Fuse Node: bert/encoder/layer_1/attention/output/dense/MatMul, Execution Time: 0.001341 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/mean, Execution Time: 0.000216 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000257 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/SquaredDifference__323, Execution Time: 0.000348 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/variance, Execution Time: 0.000164 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000089 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000070 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/Rsqrt__325, Execution Time: 0.000089 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000088 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000088 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000090 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000476 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000816 seconds
Matmul Fuse Node: bert/encoder/layer_1/intermediate/dense/MatMul, Execution Time: 0.002512 seconds
Node: bert/encoder/layer_1/intermediate/dense/Pow, Execution Time: 0.000742 seconds
Node: bert/encoder/layer_1/intermediate/dense/mul, Execution Time: 0.001210 seconds
Node: bert/encoder/layer_1/intermediate/dense/add, Execution Time: 0.001453 seconds
Node: bert/encoder/layer_1/intermediate/dense/mul_1, Execution Time: 0.001177 seconds
Node: bert/encoder/layer_1/intermediate/dense/Tanh, Execution Time: 0.001104 seconds
Node: bert/encoder/layer_1/intermediate/dense/add_1, Execution Time: 0.001200 seconds
Node: bert/encoder/layer_1/intermediate/dense/mul_2, Execution Time: 0.001139 seconds
Node: bert/encoder/layer_1/intermediate/dense/mul_3, Execution Time: 0.001420 seconds
Matmul Fuse Node: bert/encoder/layer_1/output/dense/MatMul, Execution Time: 0.002807 seconds
Node: bert/encoder/layer_1/output/LayerNorm/moments/mean, Execution Time: 0.000179 seconds
Node: bert/encoder/layer_1/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000244 seconds
Node: bert/encoder/layer_1/output/LayerNorm/moments/SquaredDifference__327, Execution Time: 0.000347 seconds
Node: bert/encoder/layer_1/output/LayerNorm/moments/variance, Execution Time: 0.000171 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/add, Execution Time: 0.000086 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000067 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/Rsqrt__329, Execution Time: 0.000091 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul, Execution Time: 0.000085 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000085 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/sub, Execution Time: 0.000087 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000323 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000448 seconds
Matmul Fuse Node: bert/encoder/layer_2/attention/self/value/MatMul, Execution Time: 0.001113 seconds
Node: bert/encoder/layer_2/attention/self/Reshape_2, Execution Time: 0.000033 seconds
Node: bert/encoder/layer_2/attention/self/transpose_2, Execution Time: 0.000248 seconds
Matmul Fuse Node: bert/encoder/layer_2/attention/self/query/MatMul, Execution Time: 0.001177 seconds
Node: bert/encoder/layer_2/attention/self/Reshape, Execution Time: 0.000012 seconds
Node: bert/encoder/layer_2/attention/self/transpose, Execution Time: 0.000249 seconds
Matmul Fuse Node: bert/encoder/layer_2/attention/self/key/MatMul, Execution Time: 0.001151 seconds
Node: bert/encoder/layer_2/attention/self/Reshape_1, Execution Time: 0.000011 seconds
Node: bert/encoder/layer_2/attention/self/MatMul__334, Execution Time: 0.000267 seconds
Node: bert/encoder/layer_2/attention/self/MatMul, Execution Time: 0.001532 seconds
Node: bert/encoder/layer_2/attention/self/Mul, Execution Time: 0.001366 seconds
Node: bert/encoder/layer_2/attention/self/add, Execution Time: 0.001867 seconds
Node: bert/encoder/layer_2/attention/self/Softmax, Execution Time: 0.001922 seconds
Node: bert/encoder/layer_2/attention/self/MatMul_1, Execution Time: 0.001145 seconds
Node: bert/encoder/layer_2/attention/self/transpose_3, Execution Time: 0.000254 seconds
Node: bert/encoder/layer_2/attention/self/Reshape_3, Execution Time: 0.000048 seconds
Matmul Fuse Node: bert/encoder/layer_2/attention/output/dense/MatMul, Execution Time: 0.001272 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/mean, Execution Time: 0.000184 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000250 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/SquaredDifference__337, Execution Time: 0.000338 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/variance, Execution Time: 0.000168 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000095 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000068 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/Rsqrt__339, Execution Time: 0.000097 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000090 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000086 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000089 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000617 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000743 seconds
Matmul Fuse Node: bert/encoder/layer_2/intermediate/dense/MatMul, Execution Time: 0.002625 seconds
Node: bert/encoder/layer_2/intermediate/dense/Pow, Execution Time: 0.000738 seconds
Node: bert/encoder/layer_2/intermediate/dense/mul, Execution Time: 0.000728 seconds
Node: bert/encoder/layer_2/intermediate/dense/add, Execution Time: 0.001621 seconds
Node: bert/encoder/layer_2/intermediate/dense/mul_1, Execution Time: 0.001329 seconds
Node: bert/encoder/layer_2/intermediate/dense/Tanh, Execution Time: 0.001489 seconds
Node: bert/encoder/layer_2/intermediate/dense/add_1, Execution Time: 0.001443 seconds
Node: bert/encoder/layer_2/intermediate/dense/mul_2, Execution Time: 0.001374 seconds
Node: bert/encoder/layer_2/intermediate/dense/mul_3, Execution Time: 0.001643 seconds
Matmul Fuse Node: bert/encoder/layer_2/output/dense/MatMul, Execution Time: 0.002868 seconds
Node: bert/encoder/layer_2/output/LayerNorm/moments/mean, Execution Time: 0.000199 seconds
Node: bert/encoder/layer_2/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000270 seconds
Node: bert/encoder/layer_2/output/LayerNorm/moments/SquaredDifference__341, Execution Time: 0.000340 seconds
Node: bert/encoder/layer_2/output/LayerNorm/moments/variance, Execution Time: 0.000165 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/add, Execution Time: 0.000096 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000068 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/Rsqrt__343, Execution Time: 0.000089 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul, Execution Time: 0.000091 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000088 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/sub, Execution Time: 0.000093 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000328 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000461 seconds
Matmul Fuse Node: bert/encoder/layer_3/attention/self/value/MatMul, Execution Time: 0.001119 seconds
Node: bert/encoder/layer_3/attention/self/Reshape_2, Execution Time: 0.000038 seconds
Node: bert/encoder/layer_3/attention/self/transpose_2, Execution Time: 0.000259 seconds
Matmul Fuse Node: bert/encoder/layer_3/attention/self/query/MatMul, Execution Time: 0.001222 seconds
Node: bert/encoder/layer_3/attention/self/Reshape, Execution Time: 0.000015 seconds
Node: bert/encoder/layer_3/attention/self/transpose, Execution Time: 0.000250 seconds
Matmul Fuse Node: bert/encoder/layer_3/attention/self/key/MatMul, Execution Time: 0.001141 seconds
Node: bert/encoder/layer_3/attention/self/Reshape_1, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_3/attention/self/MatMul__348, Execution Time: 0.000254 seconds
Node: bert/encoder/layer_3/attention/self/MatMul, Execution Time: 0.001585 seconds
Node: bert/encoder/layer_3/attention/self/Mul, Execution Time: 0.001291 seconds
Node: bert/encoder/layer_3/attention/self/add, Execution Time: 0.001927 seconds
Node: bert/encoder/layer_3/attention/self/Softmax, Execution Time: 0.001926 seconds
Node: bert/encoder/layer_3/attention/self/MatMul_1, Execution Time: 0.001073 seconds
Node: bert/encoder/layer_3/attention/self/transpose_3, Execution Time: 0.000236 seconds
Node: bert/encoder/layer_3/attention/self/Reshape_3, Execution Time: 0.000043 seconds
Matmul Fuse Node: bert/encoder/layer_3/attention/output/dense/MatMul, Execution Time: 0.001139 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/mean, Execution Time: 0.000180 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000246 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/SquaredDifference__351, Execution Time: 0.000471 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/variance, Execution Time: 0.000160 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000085 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/Rsqrt__353, Execution Time: 0.000077 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000077 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000572 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000095 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000601 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000727 seconds
Matmul Fuse Node: bert/encoder/layer_3/intermediate/dense/MatMul, Execution Time: 0.002566 seconds
Node: bert/encoder/layer_3/intermediate/dense/Pow, Execution Time: 0.000729 seconds
Node: bert/encoder/layer_3/intermediate/dense/mul, Execution Time: 0.001270 seconds
Node: bert/encoder/layer_3/intermediate/dense/add, Execution Time: 0.001456 seconds
Node: bert/encoder/layer_3/intermediate/dense/mul_1, Execution Time: 0.001170 seconds
Node: bert/encoder/layer_3/intermediate/dense/Tanh, Execution Time: 0.001105 seconds
Node: bert/encoder/layer_3/intermediate/dense/add_1, Execution Time: 0.001137 seconds
Node: bert/encoder/layer_3/intermediate/dense/mul_2, Execution Time: 0.001122 seconds
Node: bert/encoder/layer_3/intermediate/dense/mul_3, Execution Time: 0.001502 seconds
Matmul Fuse Node: bert/encoder/layer_3/output/dense/MatMul, Execution Time: 0.002578 seconds
Node: bert/encoder/layer_3/output/LayerNorm/moments/mean, Execution Time: 0.000180 seconds
Node: bert/encoder/layer_3/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000242 seconds
Node: bert/encoder/layer_3/output/LayerNorm/moments/SquaredDifference__355, Execution Time: 0.000329 seconds
Node: bert/encoder/layer_3/output/LayerNorm/moments/variance, Execution Time: 0.000155 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/add, Execution Time: 0.000088 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000065 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/Rsqrt__357, Execution Time: 0.000080 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul, Execution Time: 0.000085 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000093 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/sub, Execution Time: 0.000084 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000335 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000436 seconds
Matmul Fuse Node: bert/encoder/layer_4/attention/self/value/MatMul, Execution Time: 0.001029 seconds
Node: bert/encoder/layer_4/attention/self/Reshape_2, Execution Time: 0.000030 seconds
Node: bert/encoder/layer_4/attention/self/transpose_2, Execution Time: 0.000249 seconds
Matmul Fuse Node: bert/encoder/layer_4/attention/self/query/MatMul, Execution Time: 0.001060 seconds
Node: bert/encoder/layer_4/attention/self/Reshape, Execution Time: 0.000011 seconds
Node: bert/encoder/layer_4/attention/self/transpose, Execution Time: 0.000240 seconds
Matmul Fuse Node: bert/encoder/layer_4/attention/self/key/MatMul, Execution Time: 0.001050 seconds
Node: bert/encoder/layer_4/attention/self/Reshape_1, Execution Time: 0.000011 seconds
Node: bert/encoder/layer_4/attention/self/MatMul__362, Execution Time: 0.000246 seconds
Node: bert/encoder/layer_4/attention/self/MatMul, Execution Time: 0.001374 seconds
Node: bert/encoder/layer_4/attention/self/Mul, Execution Time: 0.001204 seconds
Node: bert/encoder/layer_4/attention/self/add, Execution Time: 0.001962 seconds
Node: bert/encoder/layer_4/attention/self/Softmax, Execution Time: 0.002048 seconds
Node: bert/encoder/layer_4/attention/self/MatMul_1, Execution Time: 0.001097 seconds
Node: bert/encoder/layer_4/attention/self/transpose_3, Execution Time: 0.000247 seconds
Node: bert/encoder/layer_4/attention/self/Reshape_3, Execution Time: 0.000042 seconds
Matmul Fuse Node: bert/encoder/layer_4/attention/output/dense/MatMul, Execution Time: 0.001256 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/mean, Execution Time: 0.000226 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000474 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/SquaredDifference__365, Execution Time: 0.000594 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/variance, Execution Time: 0.000209 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000104 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000072 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/Rsqrt__367, Execution Time: 0.000102 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000095 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000088 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000096 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000785 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000893 seconds
Matmul Fuse Node: bert/encoder/layer_4/intermediate/dense/MatMul, Execution Time: 0.003562 seconds
Node: bert/encoder/layer_4/intermediate/dense/Pow, Execution Time: 0.000870 seconds
Node: bert/encoder/layer_4/intermediate/dense/mul, Execution Time: 0.001240 seconds
Node: bert/encoder/layer_4/intermediate/dense/add, Execution Time: 0.001421 seconds
Node: bert/encoder/layer_4/intermediate/dense/mul_1, Execution Time: 0.001159 seconds
Node: bert/encoder/layer_4/intermediate/dense/Tanh, Execution Time: 0.001082 seconds
Node: bert/encoder/layer_4/intermediate/dense/add_1, Execution Time: 0.001125 seconds
Node: bert/encoder/layer_4/intermediate/dense/mul_2, Execution Time: 0.001214 seconds
Node: bert/encoder/layer_4/intermediate/dense/mul_3, Execution Time: 0.001406 seconds
Matmul Fuse Node: bert/encoder/layer_4/output/dense/MatMul, Execution Time: 0.002535 seconds
Node: bert/encoder/layer_4/output/LayerNorm/moments/mean, Execution Time: 0.000180 seconds
Node: bert/encoder/layer_4/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000245 seconds
Node: bert/encoder/layer_4/output/LayerNorm/moments/SquaredDifference__369, Execution Time: 0.000326 seconds
Node: bert/encoder/layer_4/output/LayerNorm/moments/variance, Execution Time: 0.000154 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/add, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000057 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/Rsqrt__371, Execution Time: 0.000078 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul, Execution Time: 0.000094 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000077 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/sub, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000336 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000437 seconds
Matmul Fuse Node: bert/encoder/layer_5/attention/self/value/MatMul, Execution Time: 0.001009 seconds
Node: bert/encoder/layer_5/attention/self/Reshape_2, Execution Time: 0.000031 seconds
Node: bert/encoder/layer_5/attention/self/transpose_2, Execution Time: 0.000250 seconds
Matmul Fuse Node: bert/encoder/layer_5/attention/self/query/MatMul, Execution Time: 0.001073 seconds
Node: bert/encoder/layer_5/attention/self/Reshape, Execution Time: 0.000011 seconds
Node: bert/encoder/layer_5/attention/self/transpose, Execution Time: 0.000244 seconds
Matmul Fuse Node: bert/encoder/layer_5/attention/self/key/MatMul, Execution Time: 0.001052 seconds
Node: bert/encoder/layer_5/attention/self/Reshape_1, Execution Time: 0.000010 seconds
Node: bert/encoder/layer_5/attention/self/MatMul__376, Execution Time: 0.000257 seconds
Node: bert/encoder/layer_5/attention/self/MatMul, Execution Time: 0.001416 seconds
Node: bert/encoder/layer_5/attention/self/Mul, Execution Time: 0.001200 seconds
Node: bert/encoder/layer_5/attention/self/add, Execution Time: 0.001914 seconds
Node: bert/encoder/layer_5/attention/self/Softmax, Execution Time: 0.001981 seconds
Node: bert/encoder/layer_5/attention/self/MatMul_1, Execution Time: 0.001023 seconds
Node: bert/encoder/layer_5/attention/self/transpose_3, Execution Time: 0.000232 seconds
Node: bert/encoder/layer_5/attention/self/Reshape_3, Execution Time: 0.000039 seconds
Matmul Fuse Node: bert/encoder/layer_5/attention/output/dense/MatMul, Execution Time: 0.001173 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/mean, Execution Time: 0.000174 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000250 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/SquaredDifference__379, Execution Time: 0.000332 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/variance, Execution Time: 0.000153 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000086 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000057 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/Rsqrt__381, Execution Time: 0.000094 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000089 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000093 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000335 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000574 seconds
Matmul Fuse Node: bert/encoder/layer_5/intermediate/dense/MatMul, Execution Time: 0.002356 seconds
Node: bert/encoder/layer_5/intermediate/dense/Pow, Execution Time: 0.000721 seconds
Node: bert/encoder/layer_5/intermediate/dense/mul, Execution Time: 0.001166 seconds
Node: bert/encoder/layer_5/intermediate/dense/add, Execution Time: 0.001534 seconds
Node: bert/encoder/layer_5/intermediate/dense/mul_1, Execution Time: 0.001193 seconds
Node: bert/encoder/layer_5/intermediate/dense/Tanh, Execution Time: 0.001131 seconds
Node: bert/encoder/layer_5/intermediate/dense/add_1, Execution Time: 0.001137 seconds
Node: bert/encoder/layer_5/intermediate/dense/mul_2, Execution Time: 0.001167 seconds
Node: bert/encoder/layer_5/intermediate/dense/mul_3, Execution Time: 0.001562 seconds
Matmul Fuse Node: bert/encoder/layer_5/output/dense/MatMul, Execution Time: 0.002597 seconds
Node: bert/encoder/layer_5/output/LayerNorm/moments/mean, Execution Time: 0.000172 seconds
Node: bert/encoder/layer_5/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000247 seconds
Node: bert/encoder/layer_5/output/LayerNorm/moments/SquaredDifference__383, Execution Time: 0.000327 seconds
Node: bert/encoder/layer_5/output/LayerNorm/moments/variance, Execution Time: 0.000157 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/add, Execution Time: 0.000091 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/Rsqrt__385, Execution Time: 0.000078 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul, Execution Time: 0.000095 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000077 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/sub, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000348 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000432 seconds
Matmul Fuse Node: bert/encoder/layer_6/attention/self/value/MatMul, Execution Time: 0.001027 seconds
Node: bert/encoder/layer_6/attention/self/Reshape_2, Execution Time: 0.000030 seconds
Node: bert/encoder/layer_6/attention/self/transpose_2, Execution Time: 0.000253 seconds
Matmul Fuse Node: bert/encoder/layer_6/attention/self/query/MatMul, Execution Time: 0.001019 seconds
Node: bert/encoder/layer_6/attention/self/Reshape, Execution Time: 0.000011 seconds
Node: bert/encoder/layer_6/attention/self/transpose, Execution Time: 0.000247 seconds
Matmul Fuse Node: bert/encoder/layer_6/attention/self/key/MatMul, Execution Time: 0.001019 seconds
Node: bert/encoder/layer_6/attention/self/Reshape_1, Execution Time: 0.000010 seconds
Node: bert/encoder/layer_6/attention/self/MatMul__390, Execution Time: 0.000244 seconds
Node: bert/encoder/layer_6/attention/self/MatMul, Execution Time: 0.001298 seconds
Node: bert/encoder/layer_6/attention/self/Mul, Execution Time: 0.001164 seconds
Node: bert/encoder/layer_6/attention/self/add, Execution Time: 0.001824 seconds
Node: bert/encoder/layer_6/attention/self/Softmax, Execution Time: 0.002055 seconds
Node: bert/encoder/layer_6/attention/self/MatMul_1, Execution Time: 0.001140 seconds
Node: bert/encoder/layer_6/attention/self/transpose_3, Execution Time: 0.000237 seconds
Node: bert/encoder/layer_6/attention/self/Reshape_3, Execution Time: 0.000041 seconds
Matmul Fuse Node: bert/encoder/layer_6/attention/output/dense/MatMul, Execution Time: 0.001050 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/mean, Execution Time: 0.000174 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000384 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/SquaredDifference__393, Execution Time: 0.000464 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/variance, Execution Time: 0.000159 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/Rsqrt__395, Execution Time: 0.000095 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000096 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000082 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000575 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000679 seconds
Matmul Fuse Node: bert/encoder/layer_6/intermediate/dense/MatMul, Execution Time: 0.002249 seconds
Node: bert/encoder/layer_6/intermediate/dense/Pow, Execution Time: 0.000696 seconds
Node: bert/encoder/layer_6/intermediate/dense/mul, Execution Time: 0.001198 seconds
Node: bert/encoder/layer_6/intermediate/dense/add, Execution Time: 0.001576 seconds
Node: bert/encoder/layer_6/intermediate/dense/mul_1, Execution Time: 0.001212 seconds
Node: bert/encoder/layer_6/intermediate/dense/Tanh, Execution Time: 0.001153 seconds
Node: bert/encoder/layer_6/intermediate/dense/add_1, Execution Time: 0.001153 seconds
Node: bert/encoder/layer_6/intermediate/dense/mul_2, Execution Time: 0.001147 seconds
Node: bert/encoder/layer_6/intermediate/dense/mul_3, Execution Time: 0.001544 seconds
Matmul Fuse Node: bert/encoder/layer_6/output/dense/MatMul, Execution Time: 0.002594 seconds
Node: bert/encoder/layer_6/output/LayerNorm/moments/mean, Execution Time: 0.000174 seconds
Node: bert/encoder/layer_6/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000242 seconds
Node: bert/encoder/layer_6/output/LayerNorm/moments/SquaredDifference__397, Execution Time: 0.000327 seconds
Node: bert/encoder/layer_6/output/LayerNorm/moments/variance, Execution Time: 0.000154 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/add, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000057 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/Rsqrt__399, Execution Time: 0.000083 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul, Execution Time: 0.000082 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000092 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/sub, Execution Time: 0.000080 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000347 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000422 seconds
Matmul Fuse Node: bert/encoder/layer_7/attention/self/value/MatMul, Execution Time: 0.000982 seconds
Node: bert/encoder/layer_7/attention/self/Reshape_2, Execution Time: 0.000030 seconds
Node: bert/encoder/layer_7/attention/self/transpose_2, Execution Time: 0.000257 seconds
Matmul Fuse Node: bert/encoder/layer_7/attention/self/query/MatMul, Execution Time: 0.001012 seconds
Node: bert/encoder/layer_7/attention/self/Reshape, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_7/attention/self/transpose, Execution Time: 0.000248 seconds
Matmul Fuse Node: bert/encoder/layer_7/attention/self/key/MatMul, Execution Time: 0.001033 seconds
Node: bert/encoder/layer_7/attention/self/Reshape_1, Execution Time: 0.000010 seconds
Node: bert/encoder/layer_7/attention/self/MatMul__404, Execution Time: 0.000239 seconds
Node: bert/encoder/layer_7/attention/self/MatMul, Execution Time: 0.001313 seconds
Node: bert/encoder/layer_7/attention/self/Mul, Execution Time: 0.001178 seconds
Node: bert/encoder/layer_7/attention/self/add, Execution Time: 0.001869 seconds
Node: bert/encoder/layer_7/attention/self/Softmax, Execution Time: 0.002060 seconds
Node: bert/encoder/layer_7/attention/self/MatMul_1, Execution Time: 0.001038 seconds
Node: bert/encoder/layer_7/attention/self/transpose_3, Execution Time: 0.000234 seconds
Node: bert/encoder/layer_7/attention/self/Reshape_3, Execution Time: 0.000043 seconds
Matmul Fuse Node: bert/encoder/layer_7/attention/output/dense/MatMul, Execution Time: 0.001151 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/mean, Execution Time: 0.000174 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000400 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/SquaredDifference__407, Execution Time: 0.000470 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/variance, Execution Time: 0.000160 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000080 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000063 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/Rsqrt__409, Execution Time: 0.000086 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000096 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000103 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000110 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000611 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000706 seconds
Matmul Fuse Node: bert/encoder/layer_7/intermediate/dense/MatMul, Execution Time: 0.002291 seconds
Node: bert/encoder/layer_7/intermediate/dense/Pow, Execution Time: 0.000717 seconds
Node: bert/encoder/layer_7/intermediate/dense/mul, Execution Time: 0.001195 seconds
Node: bert/encoder/layer_7/intermediate/dense/add, Execution Time: 0.001489 seconds
Node: bert/encoder/layer_7/intermediate/dense/mul_1, Execution Time: 0.001147 seconds
Node: bert/encoder/layer_7/intermediate/dense/Tanh, Execution Time: 0.001083 seconds
Node: bert/encoder/layer_7/intermediate/dense/add_1, Execution Time: 0.001118 seconds
Node: bert/encoder/layer_7/intermediate/dense/mul_2, Execution Time: 0.001120 seconds
Node: bert/encoder/layer_7/intermediate/dense/mul_3, Execution Time: 0.001441 seconds
Matmul Fuse Node: bert/encoder/layer_7/output/dense/MatMul, Execution Time: 0.002581 seconds
Node: bert/encoder/layer_7/output/LayerNorm/moments/mean, Execution Time: 0.000177 seconds
Node: bert/encoder/layer_7/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000244 seconds
Node: bert/encoder/layer_7/output/LayerNorm/moments/SquaredDifference__411, Execution Time: 0.000326 seconds
Node: bert/encoder/layer_7/output/LayerNorm/moments/variance, Execution Time: 0.000159 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/add, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000063 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/Rsqrt__413, Execution Time: 0.000099 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000090 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/sub, Execution Time: 0.000080 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000339 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000432 seconds
Matmul Fuse Node: bert/encoder/layer_8/attention/self/value/MatMul, Execution Time: 0.001000 seconds
Node: bert/encoder/layer_8/attention/self/Reshape_2, Execution Time: 0.000036 seconds
Node: bert/encoder/layer_8/attention/self/transpose_2, Execution Time: 0.000250 seconds
Matmul Fuse Node: bert/encoder/layer_8/attention/self/query/MatMul, Execution Time: 0.001027 seconds
Node: bert/encoder/layer_8/attention/self/Reshape, Execution Time: 0.000012 seconds
Node: bert/encoder/layer_8/attention/self/transpose, Execution Time: 0.000245 seconds
Matmul Fuse Node: bert/encoder/layer_8/attention/self/key/MatMul, Execution Time: 0.001011 seconds
Node: bert/encoder/layer_8/attention/self/Reshape_1, Execution Time: 0.000010 seconds
Node: bert/encoder/layer_8/attention/self/MatMul__418, Execution Time: 0.000237 seconds
Node: bert/encoder/layer_8/attention/self/MatMul, Execution Time: 0.001322 seconds
Node: bert/encoder/layer_8/attention/self/Mul, Execution Time: 0.001192 seconds
Node: bert/encoder/layer_8/attention/self/add, Execution Time: 0.002013 seconds
Node: bert/encoder/layer_8/attention/self/Softmax, Execution Time: 0.002041 seconds
Node: bert/encoder/layer_8/attention/self/MatMul_1, Execution Time: 0.000990 seconds
Node: bert/encoder/layer_8/attention/self/transpose_3, Execution Time: 0.000251 seconds
Node: bert/encoder/layer_8/attention/self/Reshape_3, Execution Time: 0.000041 seconds
Matmul Fuse Node: bert/encoder/layer_8/attention/output/dense/MatMul, Execution Time: 0.001069 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/mean, Execution Time: 0.000179 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000387 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/SquaredDifference__421, Execution Time: 0.000474 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/variance, Execution Time: 0.000162 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000065 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/Rsqrt__423, Execution Time: 0.000096 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000093 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000083 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000568 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000679 seconds
Matmul Fuse Node: bert/encoder/layer_8/intermediate/dense/MatMul, Execution Time: 0.002251 seconds
Node: bert/encoder/layer_8/intermediate/dense/Pow, Execution Time: 0.000721 seconds
Node: bert/encoder/layer_8/intermediate/dense/mul, Execution Time: 0.001218 seconds
Node: bert/encoder/layer_8/intermediate/dense/add, Execution Time: 0.001432 seconds
Node: bert/encoder/layer_8/intermediate/dense/mul_1, Execution Time: 0.001163 seconds
Node: bert/encoder/layer_8/intermediate/dense/Tanh, Execution Time: 0.001110 seconds
Node: bert/encoder/layer_8/intermediate/dense/add_1, Execution Time: 0.001143 seconds
Node: bert/encoder/layer_8/intermediate/dense/mul_2, Execution Time: 0.001137 seconds
Node: bert/encoder/layer_8/intermediate/dense/mul_3, Execution Time: 0.001478 seconds
Matmul Fuse Node: bert/encoder/layer_8/output/dense/MatMul, Execution Time: 0.002641 seconds
Node: bert/encoder/layer_8/output/LayerNorm/moments/mean, Execution Time: 0.000173 seconds
Node: bert/encoder/layer_8/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000245 seconds
Node: bert/encoder/layer_8/output/LayerNorm/moments/SquaredDifference__425, Execution Time: 0.000327 seconds
Node: bert/encoder/layer_8/output/LayerNorm/moments/variance, Execution Time: 0.000162 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/add, Execution Time: 0.000084 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/Rsqrt__427, Execution Time: 0.000083 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000092 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/sub, Execution Time: 0.000080 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000331 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000430 seconds
Matmul Fuse Node: bert/encoder/layer_9/attention/self/value/MatMul, Execution Time: 0.001014 seconds
Node: bert/encoder/layer_9/attention/self/Reshape_2, Execution Time: 0.000029 seconds
Node: bert/encoder/layer_9/attention/self/transpose_2, Execution Time: 0.000248 seconds
Matmul Fuse Node: bert/encoder/layer_9/attention/self/query/MatMul, Execution Time: 0.000995 seconds
Node: bert/encoder/layer_9/attention/self/Reshape, Execution Time: 0.000011 seconds
Node: bert/encoder/layer_9/attention/self/transpose, Execution Time: 0.000239 seconds
Matmul Fuse Node: bert/encoder/layer_9/attention/self/key/MatMul, Execution Time: 0.001013 seconds
Node: bert/encoder/layer_9/attention/self/Reshape_1, Execution Time: 0.000009 seconds
Node: bert/encoder/layer_9/attention/self/MatMul__432, Execution Time: 0.000242 seconds
Node: bert/encoder/layer_9/attention/self/MatMul, Execution Time: 0.001350 seconds
Node: bert/encoder/layer_9/attention/self/Mul, Execution Time: 0.001189 seconds
Node: bert/encoder/layer_9/attention/self/add, Execution Time: 0.001879 seconds
Node: bert/encoder/layer_9/attention/self/Softmax, Execution Time: 0.001944 seconds
Node: bert/encoder/layer_9/attention/self/MatMul_1, Execution Time: 0.001025 seconds
Node: bert/encoder/layer_9/attention/self/transpose_3, Execution Time: 0.000237 seconds
Node: bert/encoder/layer_9/attention/self/Reshape_3, Execution Time: 0.000042 seconds
Matmul Fuse Node: bert/encoder/layer_9/attention/output/dense/MatMul, Execution Time: 0.001030 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/mean, Execution Time: 0.000190 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000370 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/SquaredDifference__435, Execution Time: 0.000334 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/variance, Execution Time: 0.000161 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000087 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000065 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/Rsqrt__437, Execution Time: 0.000101 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000087 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000094 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000080 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000563 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000677 seconds
Matmul Fuse Node: bert/encoder/layer_9/intermediate/dense/MatMul, Execution Time: 0.002244 seconds
Node: bert/encoder/layer_9/intermediate/dense/Pow, Execution Time: 0.000710 seconds
Node: bert/encoder/layer_9/intermediate/dense/mul, Execution Time: 0.001240 seconds
Node: bert/encoder/layer_9/intermediate/dense/add, Execution Time: 0.001429 seconds
Node: bert/encoder/layer_9/intermediate/dense/mul_1, Execution Time: 0.001182 seconds
Node: bert/encoder/layer_9/intermediate/dense/Tanh, Execution Time: 0.001162 seconds
Node: bert/encoder/layer_9/intermediate/dense/add_1, Execution Time: 0.001181 seconds
Node: bert/encoder/layer_9/intermediate/dense/mul_2, Execution Time: 0.001178 seconds
Node: bert/encoder/layer_9/intermediate/dense/mul_3, Execution Time: 0.001511 seconds
Matmul Fuse Node: bert/encoder/layer_9/output/dense/MatMul, Execution Time: 0.002607 seconds
Node: bert/encoder/layer_9/output/LayerNorm/moments/mean, Execution Time: 0.000179 seconds
Node: bert/encoder/layer_9/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000246 seconds
Node: bert/encoder/layer_9/output/LayerNorm/moments/SquaredDifference__439, Execution Time: 0.000386 seconds
Node: bert/encoder/layer_9/output/LayerNorm/moments/variance, Execution Time: 0.000160 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/add, Execution Time: 0.000080 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000057 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/Rsqrt__441, Execution Time: 0.000084 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000076 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/sub, Execution Time: 0.000084 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000334 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000454 seconds
Matmul Fuse Node: bert/encoder/layer_10/attention/self/value/MatMul, Execution Time: 0.001012 seconds
Node: bert/encoder/layer_10/attention/self/Reshape_2, Execution Time: 0.000031 seconds
Node: bert/encoder/layer_10/attention/self/transpose_2, Execution Time: 0.000246 seconds
Matmul Fuse Node: bert/encoder/layer_10/attention/self/query/MatMul, Execution Time: 0.000926 seconds
Node: bert/encoder/layer_10/attention/self/Reshape, Execution Time: 0.000015 seconds
Node: bert/encoder/layer_10/attention/self/transpose, Execution Time: 0.000243 seconds
Matmul Fuse Node: bert/encoder/layer_10/attention/self/key/MatMul, Execution Time: 0.001030 seconds
Node: bert/encoder/layer_10/attention/self/Reshape_1, Execution Time: 0.000010 seconds
Node: bert/encoder/layer_10/attention/self/MatMul__446, Execution Time: 0.000239 seconds
Node: bert/encoder/layer_10/attention/self/MatMul, Execution Time: 0.001316 seconds
Node: bert/encoder/layer_10/attention/self/Mul, Execution Time: 0.001185 seconds
Node: bert/encoder/layer_10/attention/self/add, Execution Time: 0.001915 seconds
Node: bert/encoder/layer_10/attention/self/Softmax, Execution Time: 0.001967 seconds
Node: bert/encoder/layer_10/attention/self/MatMul_1, Execution Time: 0.001007 seconds
Node: bert/encoder/layer_10/attention/self/transpose_3, Execution Time: 0.000240 seconds
Node: bert/encoder/layer_10/attention/self/Reshape_3, Execution Time: 0.000043 seconds
Matmul Fuse Node: bert/encoder/layer_10/attention/output/dense/MatMul, Execution Time: 0.001144 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/mean, Execution Time: 0.000172 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000243 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/SquaredDifference__449, Execution Time: 0.000472 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/variance, Execution Time: 0.000158 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000057 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/Rsqrt__451, Execution Time: 0.000094 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000095 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000102 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000579 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000761 seconds
Matmul Fuse Node: bert/encoder/layer_10/intermediate/dense/MatMul, Execution Time: 0.002250 seconds
Node: bert/encoder/layer_10/intermediate/dense/Pow, Execution Time: 0.000720 seconds
Node: bert/encoder/layer_10/intermediate/dense/mul, Execution Time: 0.001231 seconds
Node: bert/encoder/layer_10/intermediate/dense/add, Execution Time: 0.001420 seconds
Node: bert/encoder/layer_10/intermediate/dense/mul_1, Execution Time: 0.001153 seconds
Node: bert/encoder/layer_10/intermediate/dense/Tanh, Execution Time: 0.001141 seconds
Node: bert/encoder/layer_10/intermediate/dense/add_1, Execution Time: 0.001123 seconds
Node: bert/encoder/layer_10/intermediate/dense/mul_2, Execution Time: 0.001118 seconds
Node: bert/encoder/layer_10/intermediate/dense/mul_3, Execution Time: 0.001471 seconds
Matmul Fuse Node: bert/encoder/layer_10/output/dense/MatMul, Execution Time: 0.002554 seconds
Node: bert/encoder/layer_10/output/LayerNorm/moments/mean, Execution Time: 0.000175 seconds
Node: bert/encoder/layer_10/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000244 seconds
Node: bert/encoder/layer_10/output/LayerNorm/moments/SquaredDifference__453, Execution Time: 0.000329 seconds
Node: bert/encoder/layer_10/output/LayerNorm/moments/variance, Execution Time: 0.000154 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/add, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000062 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/Rsqrt__455, Execution Time: 0.000082 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000073 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/sub, Execution Time: 0.000080 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000335 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000474 seconds
Matmul Fuse Node: bert/encoder/layer_11/attention/self/value/MatMul, Execution Time: 0.000986 seconds
Node: bert/encoder/layer_11/attention/self/Reshape_2, Execution Time: 0.000031 seconds
Node: bert/encoder/layer_11/attention/self/transpose_2, Execution Time: 0.000248 seconds
Matmul Fuse Node: bert/encoder/layer_11/attention/self/query/MatMul, Execution Time: 0.000993 seconds
Node: bert/encoder/layer_11/attention/self/Reshape, Execution Time: 0.000011 seconds
Node: bert/encoder/layer_11/attention/self/transpose, Execution Time: 0.000243 seconds
Matmul Fuse Node: bert/encoder/layer_11/attention/self/key/MatMul, Execution Time: 0.000986 seconds
Node: bert/encoder/layer_11/attention/self/Reshape_1, Execution Time: 0.000010 seconds
Node: bert/encoder/layer_11/attention/self/MatMul__460, Execution Time: 0.000243 seconds
Node: bert/encoder/layer_11/attention/self/MatMul, Execution Time: 0.001366 seconds
Node: bert/encoder/layer_11/attention/self/Mul, Execution Time: 0.001203 seconds
Node: bert/encoder/layer_11/attention/self/add, Execution Time: 0.001969 seconds
Node: bert/encoder/layer_11/attention/self/Softmax, Execution Time: 0.001982 seconds
Node: bert/encoder/layer_11/attention/self/MatMul_1, Execution Time: 0.000999 seconds
Node: bert/encoder/layer_11/attention/self/transpose_3, Execution Time: 0.000237 seconds
Node: bert/encoder/layer_11/attention/self/Reshape_3, Execution Time: 0.000047 seconds
Matmul Fuse Node: bert/encoder/layer_11/attention/output/dense/MatMul, Execution Time: 0.001050 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/mean, Execution Time: 0.000172 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000386 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/SquaredDifference__463, Execution Time: 0.000457 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/variance, Execution Time: 0.000158 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000082 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/Rsqrt__465, Execution Time: 0.000095 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000096 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000093 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000085 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000565 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000685 seconds
Matmul Fuse Node: bert/encoder/layer_11/intermediate/dense/MatMul, Execution Time: 0.002273 seconds
Node: bert/encoder/layer_11/intermediate/dense/Pow, Execution Time: 0.000699 seconds
Node: bert/encoder/layer_11/intermediate/dense/mul, Execution Time: 0.001246 seconds
Node: bert/encoder/layer_11/intermediate/dense/add, Execution Time: 0.001451 seconds
Node: bert/encoder/layer_11/intermediate/dense/mul_1, Execution Time: 0.001180 seconds
Node: bert/encoder/layer_11/intermediate/dense/Tanh, Execution Time: 0.001115 seconds
Node: bert/encoder/layer_11/intermediate/dense/add_1, Execution Time: 0.001137 seconds
Node: bert/encoder/layer_11/intermediate/dense/mul_2, Execution Time: 0.001217 seconds
Node: bert/encoder/layer_11/intermediate/dense/mul_3, Execution Time: 0.001421 seconds
Matmul Fuse Node: bert/encoder/layer_11/output/dense/MatMul, Execution Time: 0.002547 seconds
Node: bert/encoder/layer_11/output/LayerNorm/moments/mean, Execution Time: 0.000173 seconds
Node: bert/encoder/layer_11/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000251 seconds
Node: bert/encoder/layer_11/output/LayerNorm/moments/SquaredDifference__467, Execution Time: 0.000328 seconds
Node: bert/encoder/layer_11/output/LayerNorm/moments/variance, Execution Time: 0.000160 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/add, Execution Time: 0.000080 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000057 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/Rsqrt__469, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul, Execution Time: 0.000080 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000095 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/sub, Execution Time: 0.000083 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000335 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000435 seconds
Matmul Fuse Node: MatMul, Execution Time: 0.009455 seconds
Node: Reshape_1, Execution Time: 0.000036 seconds
Node: transpose, Execution Time: 0.000113 seconds
Node: unstack, Execution Time: 0.000066 seconds
Node: unstack__490, Execution Time: 0.000005 seconds
Node: unstack__488, Execution Time: 0.000006 seconds

Total Execution Time: 0.792230 seconds

Total Matmul Fuse Execution Time: 0.125247 seconds
Execution complete.