Untitled

Node Execution Times:
Node: unique_ids_graph_outputs_Identity__10, Execution Time: 0.000004 seconds
Node: bert/encoder/Shape, Execution Time: 0.000003 seconds
Node: bert/encoder/Shape__12, Execution Time: 0.000008 seconds
Node: bert/encoder/strided_slice, Execution Time: 0.000068 seconds
Node: bert/encoder/strided_slice__16, Execution Time: 0.000005 seconds
Node: bert/encoder/strided_slice__17, Execution Time: 0.000005 seconds
Node: bert/encoder/ones/packed_Unsqueeze__18, Execution Time: 0.000010 seconds
Node: bert/encoder/ones/packed_Concat__21, Execution Time: 0.000011 seconds
Node: bert/encoder/ones__22, Execution Time: 0.000004 seconds
Node: bert/encoder/ones, Execution Time: 0.000010 seconds
Node: bert/encoder/Reshape, Execution Time: 0.000006 seconds
Node: bert/encoder/Cast, Execution Time: 0.000004 seconds
Node: bert/encoder/mul, Execution Time: 0.028696 seconds
Node: bert/encoder/layer_9/attention/self/ExpandDims, Execution Time: 0.000036 seconds
Node: bert/encoder/layer_9/attention/self/sub, Execution Time: 0.006651 seconds
Node: bert/encoder/layer_9/attention/self/mul_1, Execution Time: 0.000334 seconds
Node: bert/embeddings/Reshape_2, Execution Time: 0.000030 seconds
Node: bert/embeddings/Reshape, Execution Time: 0.000005 seconds
Node: bert/embeddings/GatherV2, Execution Time: 0.000310 seconds
Node: bert/embeddings/Reshape_1, Execution Time: 0.000007 seconds
Node: bert/embeddings/one_hot, Execution Time: 0.000059 seconds
Node: bert/embeddings/MatMul, Execution Time: 0.059060 seconds
Node: bert/embeddings/Reshape_3, Execution Time: 0.000046 seconds
Node: bert/embeddings/add, Execution Time: 0.002314 seconds
Node: bert/embeddings/add_1, Execution Time: 0.001020 seconds
Node: bert/embeddings/LayerNorm/moments/mean, Execution Time: 0.005285 seconds
Node: bert/embeddings/LayerNorm/moments/SquaredDifference, Execution Time: 0.000703 seconds
Node: bert/embeddings/LayerNorm/moments/SquaredDifference__72, Execution Time: 0.000858 seconds
Node: bert/embeddings/LayerNorm/moments/variance, Execution Time: 0.000269 seconds
Node: bert/embeddings/LayerNorm/batchnorm/add, Execution Time: 0.000086 seconds
Node: bert/embeddings/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.009878 seconds
Node: bert/embeddings/LayerNorm/batchnorm/Rsqrt__74, Execution Time: 0.005231 seconds
Node: bert/embeddings/LayerNorm/batchnorm/mul, Execution Time: 0.000103 seconds
Node: bert/embeddings/LayerNorm/batchnorm/mul_2, Execution Time: 0.000077 seconds
Node: bert/embeddings/LayerNorm/batchnorm/sub, Execution Time: 0.000087 seconds
Node: bert/embeddings/LayerNorm/batchnorm/mul_1, Execution Time: 0.000662 seconds
Node: bert/embeddings/LayerNorm/batchnorm/add_1, Execution Time: 0.000678 seconds
Node: bert/encoder/Reshape_1, Execution Time: 0.000034 seconds
Matmul Fuse Node: bert/encoder/layer_0/attention/self/value/MatMul, Execution Time: 0.030971 seconds
Node: bert/encoder/layer_0/attention/self/Reshape_2, Execution Time: 0.000024 seconds
Node: bert/encoder/layer_0/attention/self/transpose_2, Execution Time: 0.000427 seconds
Matmul Fuse Node: bert/encoder/layer_0/attention/self/query/MatMul, Execution Time: 0.002805 seconds
Node: bert/encoder/layer_0/attention/self/Reshape, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_0/attention/self/transpose, Execution Time: 0.000251 seconds
Matmul Fuse Node: bert/encoder/layer_0/attention/self/key/MatMul, Execution Time: 0.002688 seconds
Node: bert/encoder/layer_0/attention/self/Reshape_1, Execution Time: 0.000012 seconds
Node: bert/encoder/layer_0/attention/self/MatMul__306, Execution Time: 0.000244 seconds
Node: bert/encoder/layer_0/attention/self/MatMul, Execution Time: 0.004818 seconds
Node: bert/encoder/layer_0/attention/self/Mul, Execution Time: 0.001269 seconds
Node: bert/encoder/layer_0/attention/self/add, Execution Time: 0.001885 seconds
Node: bert/encoder/layer_0/attention/self/Softmax, Execution Time: 0.010269 seconds
Node: bert/encoder/layer_0/attention/self/MatMul_1, Execution Time: 0.001319 seconds
Node: bert/encoder/layer_0/attention/self/transpose_3, Execution Time: 0.000248 seconds
Node: bert/encoder/layer_0/attention/self/Reshape_3, Execution Time: 0.000040 seconds
Matmul Fuse Node: bert/encoder/layer_0/attention/output/dense/MatMul, Execution Time: 0.004317 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/mean, Execution Time: 0.000218 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000306 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/SquaredDifference__309, Execution Time: 0.000514 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/moments/variance, Execution Time: 0.000162 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000133 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000086 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/Rsqrt__311, Execution Time: 0.000132 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000119 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000084 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000558 seconds
Node: bert/encoder/layer_0/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000680 seconds
Matmul Fuse Node: bert/encoder/layer_0/intermediate/dense/MatMul, Execution Time: 0.004838 seconds
Node: bert/encoder/layer_0/intermediate/dense/Pow, Execution Time: 0.017970 seconds
Node: bert/encoder/layer_0/intermediate/dense/mul, Execution Time: 0.001231 seconds
Node: bert/encoder/layer_0/intermediate/dense/add, Execution Time: 0.001505 seconds
Node: bert/encoder/layer_0/intermediate/dense/mul_1, Execution Time: 0.001155 seconds
Node: bert/encoder/layer_0/intermediate/dense/Tanh, Execution Time: 0.003434 seconds
Node: bert/encoder/layer_0/intermediate/dense/add_1, Execution Time: 0.001199 seconds
Node: bert/encoder/layer_0/intermediate/dense/mul_2, Execution Time: 0.001152 seconds
Node: bert/encoder/layer_0/intermediate/dense/mul_3, Execution Time: 0.001428 seconds
Matmul Fuse Node: bert/encoder/layer_0/output/dense/MatMul, Execution Time: 0.004845 seconds
Node: bert/encoder/layer_0/output/LayerNorm/moments/mean, Execution Time: 0.000203 seconds
Node: bert/encoder/layer_0/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000262 seconds
Node: bert/encoder/layer_0/output/LayerNorm/moments/SquaredDifference__313, Execution Time: 0.000376 seconds
Node: bert/encoder/layer_0/output/LayerNorm/moments/variance, Execution Time: 0.000159 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/add, Execution Time: 0.000086 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/Rsqrt__315, Execution Time: 0.000094 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000097 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/sub, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000340 seconds
Node: bert/encoder/layer_0/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000452 seconds
Matmul Fuse Node: bert/encoder/layer_1/attention/self/value/MatMul, Execution Time: 0.002701 seconds
Node: bert/encoder/layer_1/attention/self/Reshape_2, Execution Time: 0.000022 seconds
Node: bert/encoder/layer_1/attention/self/transpose_2, Execution Time: 0.000252 seconds
Matmul Fuse Node: bert/encoder/layer_1/attention/self/query/MatMul, Execution Time: 0.002448 seconds
Node: bert/encoder/layer_1/attention/self/Reshape, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_1/attention/self/transpose, Execution Time: 0.000247 seconds
Matmul Fuse Node: bert/encoder/layer_1/attention/self/key/MatMul, Execution Time: 0.002466 seconds
Node: bert/encoder/layer_1/attention/self/Reshape_1, Execution Time: 0.000011 seconds
Node: bert/encoder/layer_1/attention/self/MatMul__320, Execution Time: 0.000253 seconds
Node: bert/encoder/layer_1/attention/self/MatMul, Execution Time: 0.001351 seconds
Node: bert/encoder/layer_1/attention/self/Mul, Execution Time: 0.001199 seconds
Node: bert/encoder/layer_1/attention/self/add, Execution Time: 0.001795 seconds
Node: bert/encoder/layer_1/attention/self/Softmax, Execution Time: 0.001861 seconds
Node: bert/encoder/layer_1/attention/self/MatMul_1, Execution Time: 0.001091 seconds
Node: bert/encoder/layer_1/attention/self/transpose_3, Execution Time: 0.000239 seconds
Node: bert/encoder/layer_1/attention/self/Reshape_3, Execution Time: 0.000047 seconds
Matmul Fuse Node: bert/encoder/layer_1/attention/output/dense/MatMul, Execution Time: 0.003090 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/mean, Execution Time: 0.000208 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000248 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/SquaredDifference__323, Execution Time: 0.000635 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/moments/variance, Execution Time: 0.000173 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000086 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000062 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/Rsqrt__325, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000078 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000090 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000075 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000570 seconds
Node: bert/encoder/layer_1/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000684 seconds
Matmul Fuse Node: bert/encoder/layer_1/intermediate/dense/MatMul, Execution Time: 0.003950 seconds
Node: bert/encoder/layer_1/intermediate/dense/Pow, Execution Time: 0.000724 seconds
Node: bert/encoder/layer_1/intermediate/dense/mul, Execution Time: 0.001177 seconds
Node: bert/encoder/layer_1/intermediate/dense/add, Execution Time: 0.001458 seconds
Node: bert/encoder/layer_1/intermediate/dense/mul_1, Execution Time: 0.001172 seconds
Node: bert/encoder/layer_1/intermediate/dense/Tanh, Execution Time: 0.001122 seconds
Node: bert/encoder/layer_1/intermediate/dense/add_1, Execution Time: 0.001358 seconds
Node: bert/encoder/layer_1/intermediate/dense/mul_2, Execution Time: 0.001478 seconds
Node: bert/encoder/layer_1/intermediate/dense/mul_3, Execution Time: 0.001856 seconds
Matmul Fuse Node: bert/encoder/layer_1/output/dense/MatMul, Execution Time: 0.006121 seconds
Node: bert/encoder/layer_1/output/LayerNorm/moments/mean, Execution Time: 0.000201 seconds
Node: bert/encoder/layer_1/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000250 seconds
Node: bert/encoder/layer_1/output/LayerNorm/moments/SquaredDifference__327, Execution Time: 0.000334 seconds
Node: bert/encoder/layer_1/output/LayerNorm/moments/variance, Execution Time: 0.000156 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/add, Execution Time: 0.000095 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000062 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/Rsqrt__329, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000092 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/sub, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000335 seconds
Node: bert/encoder/layer_1/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000435 seconds
Matmul Fuse Node: bert/encoder/layer_2/attention/self/value/MatMul, Execution Time: 0.002596 seconds
Node: bert/encoder/layer_2/attention/self/Reshape_2, Execution Time: 0.000021 seconds
Node: bert/encoder/layer_2/attention/self/transpose_2, Execution Time: 0.000247 seconds
Matmul Fuse Node: bert/encoder/layer_2/attention/self/query/MatMul, Execution Time: 0.002432 seconds
Node: bert/encoder/layer_2/attention/self/Reshape, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_2/attention/self/transpose, Execution Time: 0.000243 seconds
Matmul Fuse Node: bert/encoder/layer_2/attention/self/key/MatMul, Execution Time: 0.002502 seconds
Node: bert/encoder/layer_2/attention/self/Reshape_1, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_2/attention/self/MatMul__334, Execution Time: 0.000249 seconds
Node: bert/encoder/layer_2/attention/self/MatMul, Execution Time: 0.001394 seconds
Node: bert/encoder/layer_2/attention/self/Mul, Execution Time: 0.001164 seconds
Node: bert/encoder/layer_2/attention/self/add, Execution Time: 0.001789 seconds
Node: bert/encoder/layer_2/attention/self/Softmax, Execution Time: 0.001926 seconds
Node: bert/encoder/layer_2/attention/self/MatMul_1, Execution Time: 0.001041 seconds
Node: bert/encoder/layer_2/attention/self/transpose_3, Execution Time: 0.000241 seconds
Node: bert/encoder/layer_2/attention/self/Reshape_3, Execution Time: 0.000043 seconds
Matmul Fuse Node: bert/encoder/layer_2/attention/output/dense/MatMul, Execution Time: 0.003005 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/mean, Execution Time: 0.000185 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000250 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/SquaredDifference__337, Execution Time: 0.000337 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/moments/variance, Execution Time: 0.000158 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000085 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/Rsqrt__339, Execution Time: 0.000103 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000082 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000077 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000083 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000580 seconds
Node: bert/encoder/layer_2/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000849 seconds
Matmul Fuse Node: bert/encoder/layer_2/intermediate/dense/MatMul, Execution Time: 0.003772 seconds
Node: bert/encoder/layer_2/intermediate/dense/Pow, Execution Time: 0.000718 seconds
Node: bert/encoder/layer_2/intermediate/dense/mul, Execution Time: 0.001149 seconds
Node: bert/encoder/layer_2/intermediate/dense/add, Execution Time: 0.001441 seconds
Node: bert/encoder/layer_2/intermediate/dense/mul_1, Execution Time: 0.001095 seconds
Node: bert/encoder/layer_2/intermediate/dense/Tanh, Execution Time: 0.001091 seconds
Node: bert/encoder/layer_2/intermediate/dense/add_1, Execution Time: 0.001123 seconds
Node: bert/encoder/layer_2/intermediate/dense/mul_2, Execution Time: 0.001141 seconds
Node: bert/encoder/layer_2/intermediate/dense/mul_3, Execution Time: 0.001399 seconds
Matmul Fuse Node: bert/encoder/layer_2/output/dense/MatMul, Execution Time: 0.005045 seconds
Node: bert/encoder/layer_2/output/LayerNorm/moments/mean, Execution Time: 0.000190 seconds
Node: bert/encoder/layer_2/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000255 seconds
Node: bert/encoder/layer_2/output/LayerNorm/moments/SquaredDifference__341, Execution Time: 0.000339 seconds
Node: bert/encoder/layer_2/output/LayerNorm/moments/variance, Execution Time: 0.000158 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/add, Execution Time: 0.000086 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/Rsqrt__343, Execution Time: 0.000094 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000082 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/sub, Execution Time: 0.000083 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000337 seconds
Node: bert/encoder/layer_2/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000430 seconds
Matmul Fuse Node: bert/encoder/layer_3/attention/self/value/MatMul, Execution Time: 0.002567 seconds
Node: bert/encoder/layer_3/attention/self/Reshape_2, Execution Time: 0.000022 seconds
Node: bert/encoder/layer_3/attention/self/transpose_2, Execution Time: 0.000258 seconds
Matmul Fuse Node: bert/encoder/layer_3/attention/self/query/MatMul, Execution Time: 0.002386 seconds
Node: bert/encoder/layer_3/attention/self/Reshape, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_3/attention/self/transpose, Execution Time: 0.000250 seconds
Matmul Fuse Node: bert/encoder/layer_3/attention/self/key/MatMul, Execution Time: 0.003544 seconds
Node: bert/encoder/layer_3/attention/self/Reshape_1, Execution Time: 0.000012 seconds
Node: bert/encoder/layer_3/attention/self/MatMul__348, Execution Time: 0.000248 seconds
Node: bert/encoder/layer_3/attention/self/MatMul, Execution Time: 0.001356 seconds
Node: bert/encoder/layer_3/attention/self/Mul, Execution Time: 0.001227 seconds
Node: bert/encoder/layer_3/attention/self/add, Execution Time: 0.001745 seconds
Node: bert/encoder/layer_3/attention/self/Softmax, Execution Time: 0.001936 seconds
Node: bert/encoder/layer_3/attention/self/MatMul_1, Execution Time: 0.001074 seconds
Node: bert/encoder/layer_3/attention/self/transpose_3, Execution Time: 0.000240 seconds
Node: bert/encoder/layer_3/attention/self/Reshape_3, Execution Time: 0.000049 seconds
Matmul Fuse Node: bert/encoder/layer_3/attention/output/dense/MatMul, Execution Time: 0.003068 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/mean, Execution Time: 0.000205 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000252 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/SquaredDifference__351, Execution Time: 0.000335 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/moments/variance, Execution Time: 0.000160 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000092 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000072 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/Rsqrt__353, Execution Time: 0.000100 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000085 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000093 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000341 seconds
Node: bert/encoder/layer_3/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000437 seconds
Matmul Fuse Node: bert/encoder/layer_3/intermediate/dense/MatMul, Execution Time: 0.003851 seconds
Node: bert/encoder/layer_3/intermediate/dense/Pow, Execution Time: 0.000718 seconds
Node: bert/encoder/layer_3/intermediate/dense/mul, Execution Time: 0.001190 seconds
Node: bert/encoder/layer_3/intermediate/dense/add, Execution Time: 0.001441 seconds
Node: bert/encoder/layer_3/intermediate/dense/mul_1, Execution Time: 0.001130 seconds
Node: bert/encoder/layer_3/intermediate/dense/Tanh, Execution Time: 0.001110 seconds
Node: bert/encoder/layer_3/intermediate/dense/add_1, Execution Time: 0.001122 seconds
Node: bert/encoder/layer_3/intermediate/dense/mul_2, Execution Time: 0.001107 seconds
Node: bert/encoder/layer_3/intermediate/dense/mul_3, Execution Time: 0.001397 seconds
Matmul Fuse Node: bert/encoder/layer_3/output/dense/MatMul, Execution Time: 0.004806 seconds
Node: bert/encoder/layer_3/output/LayerNorm/moments/mean, Execution Time: 0.000209 seconds
Node: bert/encoder/layer_3/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000252 seconds
Node: bert/encoder/layer_3/output/LayerNorm/moments/SquaredDifference__355, Execution Time: 0.000334 seconds
Node: bert/encoder/layer_3/output/LayerNorm/moments/variance, Execution Time: 0.000164 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/add, Execution Time: 0.000087 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/Rsqrt__357, Execution Time: 0.000086 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul, Execution Time: 0.000082 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000092 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/sub, Execution Time: 0.000080 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000333 seconds
Node: bert/encoder/layer_3/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000443 seconds
Matmul Fuse Node: bert/encoder/layer_4/attention/self/value/MatMul, Execution Time: 0.002538 seconds
Node: bert/encoder/layer_4/attention/self/Reshape_2, Execution Time: 0.000026 seconds
Node: bert/encoder/layer_4/attention/self/transpose_2, Execution Time: 0.000253 seconds
Matmul Fuse Node: bert/encoder/layer_4/attention/self/query/MatMul, Execution Time: 0.002442 seconds
Node: bert/encoder/layer_4/attention/self/Reshape, Execution Time: 0.000016 seconds
Node: bert/encoder/layer_4/attention/self/transpose, Execution Time: 0.000250 seconds
Matmul Fuse Node: bert/encoder/layer_4/attention/self/key/MatMul, Execution Time: 0.002484 seconds
Node: bert/encoder/layer_4/attention/self/Reshape_1, Execution Time: 0.000015 seconds
Node: bert/encoder/layer_4/attention/self/MatMul__362, Execution Time: 0.000250 seconds
Node: bert/encoder/layer_4/attention/self/MatMul, Execution Time: 0.001369 seconds
Node: bert/encoder/layer_4/attention/self/Mul, Execution Time: 0.001220 seconds
Node: bert/encoder/layer_4/attention/self/add, Execution Time: 0.001841 seconds
Node: bert/encoder/layer_4/attention/self/Softmax, Execution Time: 0.001876 seconds
Node: bert/encoder/layer_4/attention/self/MatMul_1, Execution Time: 0.001034 seconds
Node: bert/encoder/layer_4/attention/self/transpose_3, Execution Time: 0.000237 seconds
Node: bert/encoder/layer_4/attention/self/Reshape_3, Execution Time: 0.000038 seconds
Matmul Fuse Node: bert/encoder/layer_4/attention/output/dense/MatMul, Execution Time: 0.002957 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/mean, Execution Time: 0.000183 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000251 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/SquaredDifference__365, Execution Time: 0.000514 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/moments/variance, Execution Time: 0.000168 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000084 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/Rsqrt__367, Execution Time: 0.000093 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000096 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000090 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000087 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000564 seconds
Node: bert/encoder/layer_4/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000678 seconds
Matmul Fuse Node: bert/encoder/layer_4/intermediate/dense/MatMul, Execution Time: 0.003731 seconds
Node: bert/encoder/layer_4/intermediate/dense/Pow, Execution Time: 0.000716 seconds
Node: bert/encoder/layer_4/intermediate/dense/mul, Execution Time: 0.001149 seconds
Node: bert/encoder/layer_4/intermediate/dense/add, Execution Time: 0.001450 seconds
Node: bert/encoder/layer_4/intermediate/dense/mul_1, Execution Time: 0.001145 seconds
Node: bert/encoder/layer_4/intermediate/dense/Tanh, Execution Time: 0.001126 seconds
Node: bert/encoder/layer_4/intermediate/dense/add_1, Execution Time: 0.001118 seconds
Node: bert/encoder/layer_4/intermediate/dense/mul_2, Execution Time: 0.001137 seconds
Node: bert/encoder/layer_4/intermediate/dense/mul_3, Execution Time: 0.001413 seconds
Matmul Fuse Node: bert/encoder/layer_4/output/dense/MatMul, Execution Time: 0.004745 seconds
Node: bert/encoder/layer_4/output/LayerNorm/moments/mean, Execution Time: 0.000207 seconds
Node: bert/encoder/layer_4/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000256 seconds
Node: bert/encoder/layer_4/output/LayerNorm/moments/SquaredDifference__369, Execution Time: 0.000335 seconds
Node: bert/encoder/layer_4/output/LayerNorm/moments/variance, Execution Time: 0.000169 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/add, Execution Time: 0.000086 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000056 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/Rsqrt__371, Execution Time: 0.000078 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul, Execution Time: 0.000082 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000077 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/sub, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000354 seconds
Node: bert/encoder/layer_4/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000426 seconds
Matmul Fuse Node: bert/encoder/layer_5/attention/self/value/MatMul, Execution Time: 0.002558 seconds
Node: bert/encoder/layer_5/attention/self/Reshape_2, Execution Time: 0.000022 seconds
Node: bert/encoder/layer_5/attention/self/transpose_2, Execution Time: 0.000254 seconds
Matmul Fuse Node: bert/encoder/layer_5/attention/self/query/MatMul, Execution Time: 0.002478 seconds
Node: bert/encoder/layer_5/attention/self/Reshape, Execution Time: 0.000016 seconds
Node: bert/encoder/layer_5/attention/self/transpose, Execution Time: 0.000254 seconds
Matmul Fuse Node: bert/encoder/layer_5/attention/self/key/MatMul, Execution Time: 0.002510 seconds
Node: bert/encoder/layer_5/attention/self/Reshape_1, Execution Time: 0.000015 seconds
Node: bert/encoder/layer_5/attention/self/MatMul__376, Execution Time: 0.000252 seconds
Node: bert/encoder/layer_5/attention/self/MatMul, Execution Time: 0.001384 seconds
Node: bert/encoder/layer_5/attention/self/Mul, Execution Time: 0.001245 seconds
Node: bert/encoder/layer_5/attention/self/add, Execution Time: 0.001780 seconds
Node: bert/encoder/layer_5/attention/self/Softmax, Execution Time: 0.001858 seconds
Node: bert/encoder/layer_5/attention/self/MatMul_1, Execution Time: 0.001036 seconds
Node: bert/encoder/layer_5/attention/self/transpose_3, Execution Time: 0.000239 seconds
Node: bert/encoder/layer_5/attention/self/Reshape_3, Execution Time: 0.000041 seconds
Matmul Fuse Node: bert/encoder/layer_5/attention/output/dense/MatMul, Execution Time: 0.002937 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/mean, Execution Time: 0.000194 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000249 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/SquaredDifference__379, Execution Time: 0.000519 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/moments/variance, Execution Time: 0.000165 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000083 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/Rsqrt__381, Execution Time: 0.000089 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000099 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000078 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000077 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000737 seconds
Node: bert/encoder/layer_5/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000695 seconds
Matmul Fuse Node: bert/encoder/layer_5/intermediate/dense/MatMul, Execution Time: 0.003810 seconds
Node: bert/encoder/layer_5/intermediate/dense/Pow, Execution Time: 0.000719 seconds
Node: bert/encoder/layer_5/intermediate/dense/mul, Execution Time: 0.001222 seconds
Node: bert/encoder/layer_5/intermediate/dense/add, Execution Time: 0.001454 seconds
Node: bert/encoder/layer_5/intermediate/dense/mul_1, Execution Time: 0.001124 seconds
Node: bert/encoder/layer_5/intermediate/dense/Tanh, Execution Time: 0.001086 seconds
Node: bert/encoder/layer_5/intermediate/dense/add_1, Execution Time: 0.001140 seconds
Node: bert/encoder/layer_5/intermediate/dense/mul_2, Execution Time: 0.001150 seconds
Node: bert/encoder/layer_5/intermediate/dense/mul_3, Execution Time: 0.001414 seconds
Matmul Fuse Node: bert/encoder/layer_5/output/dense/MatMul, Execution Time: 0.004844 seconds
Node: bert/encoder/layer_5/output/LayerNorm/moments/mean, Execution Time: 0.000205 seconds
Node: bert/encoder/layer_5/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000251 seconds
Node: bert/encoder/layer_5/output/LayerNorm/moments/SquaredDifference__383, Execution Time: 0.000339 seconds
Node: bert/encoder/layer_5/output/LayerNorm/moments/variance, Execution Time: 0.000161 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/add, Execution Time: 0.000088 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/Rsqrt__385, Execution Time: 0.000095 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul, Execution Time: 0.000087 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000077 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/sub, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000350 seconds
Node: bert/encoder/layer_5/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000434 seconds
Matmul Fuse Node: bert/encoder/layer_6/attention/self/value/MatMul, Execution Time: 0.002603 seconds
Node: bert/encoder/layer_6/attention/self/Reshape_2, Execution Time: 0.000022 seconds
Node: bert/encoder/layer_6/attention/self/transpose_2, Execution Time: 0.000255 seconds
Matmul Fuse Node: bert/encoder/layer_6/attention/self/query/MatMul, Execution Time: 0.002407 seconds
Node: bert/encoder/layer_6/attention/self/Reshape, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_6/attention/self/transpose, Execution Time: 0.000250 seconds
Matmul Fuse Node: bert/encoder/layer_6/attention/self/key/MatMul, Execution Time: 0.003754 seconds
Node: bert/encoder/layer_6/attention/self/Reshape_1, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_6/attention/self/MatMul__390, Execution Time: 0.000256 seconds
Node: bert/encoder/layer_6/attention/self/MatMul, Execution Time: 0.001370 seconds
Node: bert/encoder/layer_6/attention/self/Mul, Execution Time: 0.001158 seconds
Node: bert/encoder/layer_6/attention/self/add, Execution Time: 0.001717 seconds
Node: bert/encoder/layer_6/attention/self/Softmax, Execution Time: 0.001954 seconds
Node: bert/encoder/layer_6/attention/self/MatMul_1, Execution Time: 0.001045 seconds
Node: bert/encoder/layer_6/attention/self/transpose_3, Execution Time: 0.000248 seconds
Node: bert/encoder/layer_6/attention/self/Reshape_3, Execution Time: 0.000048 seconds
Matmul Fuse Node: bert/encoder/layer_6/attention/output/dense/MatMul, Execution Time: 0.003247 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/mean, Execution Time: 0.000247 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000322 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/SquaredDifference__393, Execution Time: 0.000446 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/moments/variance, Execution Time: 0.000210 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000105 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000074 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/Rsqrt__395, Execution Time: 0.000099 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000098 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000089 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000101 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000452 seconds
Node: bert/encoder/layer_6/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000901 seconds
Matmul Fuse Node: bert/encoder/layer_6/intermediate/dense/MatMul, Execution Time: 0.005397 seconds
Node: bert/encoder/layer_6/intermediate/dense/Pow, Execution Time: 0.000734 seconds
Node: bert/encoder/layer_6/intermediate/dense/mul, Execution Time: 0.001167 seconds
Node: bert/encoder/layer_6/intermediate/dense/add, Execution Time: 0.001413 seconds
Node: bert/encoder/layer_6/intermediate/dense/mul_1, Execution Time: 0.001107 seconds
Node: bert/encoder/layer_6/intermediate/dense/Tanh, Execution Time: 0.001155 seconds
Node: bert/encoder/layer_6/intermediate/dense/add_1, Execution Time: 0.001094 seconds
Node: bert/encoder/layer_6/intermediate/dense/mul_2, Execution Time: 0.001110 seconds
Node: bert/encoder/layer_6/intermediate/dense/mul_3, Execution Time: 0.001382 seconds
Matmul Fuse Node: bert/encoder/layer_6/output/dense/MatMul, Execution Time: 0.004541 seconds
Node: bert/encoder/layer_6/output/LayerNorm/moments/mean, Execution Time: 0.000203 seconds
Node: bert/encoder/layer_6/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000272 seconds
Node: bert/encoder/layer_6/output/LayerNorm/moments/SquaredDifference__397, Execution Time: 0.000334 seconds
Node: bert/encoder/layer_6/output/LayerNorm/moments/variance, Execution Time: 0.000171 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/add, Execution Time: 0.000089 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000060 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/Rsqrt__399, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul, Execution Time: 0.000082 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000096 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/sub, Execution Time: 0.000084 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000344 seconds
Node: bert/encoder/layer_6/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000434 seconds
Matmul Fuse Node: bert/encoder/layer_7/attention/self/value/MatMul, Execution Time: 0.002522 seconds
Node: bert/encoder/layer_7/attention/self/Reshape_2, Execution Time: 0.000022 seconds
Node: bert/encoder/layer_7/attention/self/transpose_2, Execution Time: 0.000253 seconds
Matmul Fuse Node: bert/encoder/layer_7/attention/self/query/MatMul, Execution Time: 0.002551 seconds
Node: bert/encoder/layer_7/attention/self/Reshape, Execution Time: 0.000016 seconds
Node: bert/encoder/layer_7/attention/self/transpose, Execution Time: 0.000256 seconds
Matmul Fuse Node: bert/encoder/layer_7/attention/self/key/MatMul, Execution Time: 0.002540 seconds
Node: bert/encoder/layer_7/attention/self/Reshape_1, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_7/attention/self/MatMul__404, Execution Time: 0.000262 seconds
Node: bert/encoder/layer_7/attention/self/MatMul, Execution Time: 0.001335 seconds
Node: bert/encoder/layer_7/attention/self/Mul, Execution Time: 0.001193 seconds
Node: bert/encoder/layer_7/attention/self/add, Execution Time: 0.001794 seconds
Node: bert/encoder/layer_7/attention/self/Softmax, Execution Time: 0.001873 seconds
Node: bert/encoder/layer_7/attention/self/MatMul_1, Execution Time: 0.001001 seconds
Node: bert/encoder/layer_7/attention/self/transpose_3, Execution Time: 0.000260 seconds
Node: bert/encoder/layer_7/attention/self/Reshape_3, Execution Time: 0.000038 seconds
Matmul Fuse Node: bert/encoder/layer_7/attention/output/dense/MatMul, Execution Time: 0.002723 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/mean, Execution Time: 0.000183 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000252 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/SquaredDifference__407, Execution Time: 0.000509 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/moments/variance, Execution Time: 0.000165 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000084 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/Rsqrt__409, Execution Time: 0.000097 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000080 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000565 seconds
Node: bert/encoder/layer_7/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000674 seconds
Matmul Fuse Node: bert/encoder/layer_7/intermediate/dense/MatMul, Execution Time: 0.003911 seconds
Node: bert/encoder/layer_7/intermediate/dense/Pow, Execution Time: 0.000732 seconds
Node: bert/encoder/layer_7/intermediate/dense/mul, Execution Time: 0.001142 seconds
Node: bert/encoder/layer_7/intermediate/dense/add, Execution Time: 0.001447 seconds
Node: bert/encoder/layer_7/intermediate/dense/mul_1, Execution Time: 0.001101 seconds
Node: bert/encoder/layer_7/intermediate/dense/Tanh, Execution Time: 0.001111 seconds
Node: bert/encoder/layer_7/intermediate/dense/add_1, Execution Time: 0.001125 seconds
Node: bert/encoder/layer_7/intermediate/dense/mul_2, Execution Time: 0.001132 seconds
Node: bert/encoder/layer_7/intermediate/dense/mul_3, Execution Time: 0.001391 seconds
Matmul Fuse Node: bert/encoder/layer_7/output/dense/MatMul, Execution Time: 0.004840 seconds
Node: bert/encoder/layer_7/output/LayerNorm/moments/mean, Execution Time: 0.000205 seconds
Node: bert/encoder/layer_7/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000260 seconds
Node: bert/encoder/layer_7/output/LayerNorm/moments/SquaredDifference__411, Execution Time: 0.000333 seconds
Node: bert/encoder/layer_7/output/LayerNorm/moments/variance, Execution Time: 0.000169 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/add, Execution Time: 0.000088 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000064 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/Rsqrt__413, Execution Time: 0.000083 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul, Execution Time: 0.000097 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000101 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/sub, Execution Time: 0.000097 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000442 seconds
Node: bert/encoder/layer_7/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000585 seconds
Matmul Fuse Node: bert/encoder/layer_8/attention/self/value/MatMul, Execution Time: 0.003008 seconds
Node: bert/encoder/layer_8/attention/self/Reshape_2, Execution Time: 0.000031 seconds
Node: bert/encoder/layer_8/attention/self/transpose_2, Execution Time: 0.000342 seconds
Matmul Fuse Node: bert/encoder/layer_8/attention/self/query/MatMul, Execution Time: 0.003126 seconds
Node: bert/encoder/layer_8/attention/self/Reshape, Execution Time: 0.000021 seconds
Node: bert/encoder/layer_8/attention/self/transpose, Execution Time: 0.000339 seconds
Matmul Fuse Node: bert/encoder/layer_8/attention/self/key/MatMul, Execution Time: 0.002685 seconds
Node: bert/encoder/layer_8/attention/self/Reshape_1, Execution Time: 0.000015 seconds
Node: bert/encoder/layer_8/attention/self/MatMul__418, Execution Time: 0.000270 seconds
Node: bert/encoder/layer_8/attention/self/MatMul, Execution Time: 0.001399 seconds
Node: bert/encoder/layer_8/attention/self/Mul, Execution Time: 0.001163 seconds
Node: bert/encoder/layer_8/attention/self/add, Execution Time: 0.001842 seconds
Node: bert/encoder/layer_8/attention/self/Softmax, Execution Time: 0.001884 seconds
Node: bert/encoder/layer_8/attention/self/MatMul_1, Execution Time: 0.001034 seconds
Node: bert/encoder/layer_8/attention/self/transpose_3, Execution Time: 0.000244 seconds
Node: bert/encoder/layer_8/attention/self/Reshape_3, Execution Time: 0.000040 seconds
Matmul Fuse Node: bert/encoder/layer_8/attention/output/dense/MatMul, Execution Time: 0.002817 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/mean, Execution Time: 0.000187 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000249 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/SquaredDifference__421, Execution Time: 0.000342 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/moments/variance, Execution Time: 0.000160 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000084 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/Rsqrt__423, Execution Time: 0.000093 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000075 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000082 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000573 seconds
Node: bert/encoder/layer_8/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000669 seconds
Matmul Fuse Node: bert/encoder/layer_8/intermediate/dense/MatMul, Execution Time: 0.003873 seconds
Node: bert/encoder/layer_8/intermediate/dense/Pow, Execution Time: 0.000729 seconds
Node: bert/encoder/layer_8/intermediate/dense/mul, Execution Time: 0.001137 seconds
Node: bert/encoder/layer_8/intermediate/dense/add, Execution Time: 0.001446 seconds
Node: bert/encoder/layer_8/intermediate/dense/mul_1, Execution Time: 0.001181 seconds
Node: bert/encoder/layer_8/intermediate/dense/Tanh, Execution Time: 0.001114 seconds
Node: bert/encoder/layer_8/intermediate/dense/add_1, Execution Time: 0.001114 seconds
Node: bert/encoder/layer_8/intermediate/dense/mul_2, Execution Time: 0.001146 seconds
Node: bert/encoder/layer_8/intermediate/dense/mul_3, Execution Time: 0.001413 seconds
Matmul Fuse Node: bert/encoder/layer_8/output/dense/MatMul, Execution Time: 0.004535 seconds
Node: bert/encoder/layer_8/output/LayerNorm/moments/mean, Execution Time: 0.000190 seconds
Node: bert/encoder/layer_8/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000256 seconds
Node: bert/encoder/layer_8/output/LayerNorm/moments/SquaredDifference__425, Execution Time: 0.000340 seconds
Node: bert/encoder/layer_8/output/LayerNorm/moments/variance, Execution Time: 0.000157 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/add, Execution Time: 0.000087 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000058 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/Rsqrt__427, Execution Time: 0.000078 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul, Execution Time: 0.000086 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000077 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/sub, Execution Time: 0.000085 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000347 seconds
Node: bert/encoder/layer_8/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000445 seconds
Matmul Fuse Node: bert/encoder/layer_9/attention/self/value/MatMul, Execution Time: 0.002481 seconds
Node: bert/encoder/layer_9/attention/self/Reshape_2, Execution Time: 0.000021 seconds
Node: bert/encoder/layer_9/attention/self/transpose_2, Execution Time: 0.000257 seconds
Matmul Fuse Node: bert/encoder/layer_9/attention/self/query/MatMul, Execution Time: 0.002502 seconds
Node: bert/encoder/layer_9/attention/self/Reshape, Execution Time: 0.000021 seconds
Node: bert/encoder/layer_9/attention/self/transpose, Execution Time: 0.000251 seconds
Matmul Fuse Node: bert/encoder/layer_9/attention/self/key/MatMul, Execution Time: 0.003817 seconds
Node: bert/encoder/layer_9/attention/self/Reshape_1, Execution Time: 0.000015 seconds
Node: bert/encoder/layer_9/attention/self/MatMul__432, Execution Time: 0.000252 seconds
Node: bert/encoder/layer_9/attention/self/MatMul, Execution Time: 0.001313 seconds
Node: bert/encoder/layer_9/attention/self/Mul, Execution Time: 0.001195 seconds
Node: bert/encoder/layer_9/attention/self/add, Execution Time: 0.001731 seconds
Node: bert/encoder/layer_9/attention/self/Softmax, Execution Time: 0.001865 seconds
Node: bert/encoder/layer_9/attention/self/MatMul_1, Execution Time: 0.001047 seconds
Node: bert/encoder/layer_9/attention/self/transpose_3, Execution Time: 0.000242 seconds
Node: bert/encoder/layer_9/attention/self/Reshape_3, Execution Time: 0.000049 seconds
Matmul Fuse Node: bert/encoder/layer_9/attention/output/dense/MatMul, Execution Time: 0.002703 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/mean, Execution Time: 0.000196 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000253 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/SquaredDifference__435, Execution Time: 0.000333 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/moments/variance, Execution Time: 0.000159 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000084 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000085 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/Rsqrt__437, Execution Time: 0.000095 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000083 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000091 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000629 seconds
Node: bert/encoder/layer_9/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000675 seconds
Matmul Fuse Node: bert/encoder/layer_9/intermediate/dense/MatMul, Execution Time: 0.003888 seconds
Node: bert/encoder/layer_9/intermediate/dense/Pow, Execution Time: 0.000730 seconds
Node: bert/encoder/layer_9/intermediate/dense/mul, Execution Time: 0.001163 seconds
Node: bert/encoder/layer_9/intermediate/dense/add, Execution Time: 0.001472 seconds
Node: bert/encoder/layer_9/intermediate/dense/mul_1, Execution Time: 0.001139 seconds
Node: bert/encoder/layer_9/intermediate/dense/Tanh, Execution Time: 0.001132 seconds
Node: bert/encoder/layer_9/intermediate/dense/add_1, Execution Time: 0.001132 seconds
Node: bert/encoder/layer_9/intermediate/dense/mul_2, Execution Time: 0.001113 seconds
Node: bert/encoder/layer_9/intermediate/dense/mul_3, Execution Time: 0.001410 seconds
Matmul Fuse Node: bert/encoder/layer_9/output/dense/MatMul, Execution Time: 0.004902 seconds
Node: bert/encoder/layer_9/output/LayerNorm/moments/mean, Execution Time: 0.000193 seconds
Node: bert/encoder/layer_9/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000254 seconds
Node: bert/encoder/layer_9/output/LayerNorm/moments/SquaredDifference__439, Execution Time: 0.000335 seconds
Node: bert/encoder/layer_9/output/LayerNorm/moments/variance, Execution Time: 0.000158 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/add, Execution Time: 0.000088 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/Rsqrt__441, Execution Time: 0.000084 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul, Execution Time: 0.000086 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/sub, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000339 seconds
Node: bert/encoder/layer_9/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000445 seconds
Matmul Fuse Node: bert/encoder/layer_10/attention/self/value/MatMul, Execution Time: 0.002502 seconds
Node: bert/encoder/layer_10/attention/self/Reshape_2, Execution Time: 0.000021 seconds
Node: bert/encoder/layer_10/attention/self/transpose_2, Execution Time: 0.000261 seconds
Matmul Fuse Node: bert/encoder/layer_10/attention/self/query/MatMul, Execution Time: 0.002476 seconds
Node: bert/encoder/layer_10/attention/self/Reshape, Execution Time: 0.000014 seconds
Node: bert/encoder/layer_10/attention/self/transpose, Execution Time: 0.000254 seconds
Matmul Fuse Node: bert/encoder/layer_10/attention/self/key/MatMul, Execution Time: 0.002367 seconds
Node: bert/encoder/layer_10/attention/self/Reshape_1, Execution Time: 0.000013 seconds
Node: bert/encoder/layer_10/attention/self/MatMul__446, Execution Time: 0.000256 seconds
Node: bert/encoder/layer_10/attention/self/MatMul, Execution Time: 0.001315 seconds
Node: bert/encoder/layer_10/attention/self/Mul, Execution Time: 0.001199 seconds
Node: bert/encoder/layer_10/attention/self/add, Execution Time: 0.001811 seconds
Node: bert/encoder/layer_10/attention/self/Softmax, Execution Time: 0.001871 seconds
Node: bert/encoder/layer_10/attention/self/MatMul_1, Execution Time: 0.001035 seconds
Node: bert/encoder/layer_10/attention/self/transpose_3, Execution Time: 0.000242 seconds
Node: bert/encoder/layer_10/attention/self/Reshape_3, Execution Time: 0.000034 seconds
Matmul Fuse Node: bert/encoder/layer_10/attention/output/dense/MatMul, Execution Time: 0.002789 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/mean, Execution Time: 0.000185 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000264 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/SquaredDifference__449, Execution Time: 0.000458 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/moments/variance, Execution Time: 0.000165 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000086 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/Rsqrt__451, Execution Time: 0.000082 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000080 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000611 seconds
Node: bert/encoder/layer_10/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000701 seconds
Matmul Fuse Node: bert/encoder/layer_10/intermediate/dense/MatMul, Execution Time: 0.003783 seconds
Node: bert/encoder/layer_10/intermediate/dense/Pow, Execution Time: 0.000716 seconds
Node: bert/encoder/layer_10/intermediate/dense/mul, Execution Time: 0.001157 seconds
Node: bert/encoder/layer_10/intermediate/dense/add, Execution Time: 0.001480 seconds
Node: bert/encoder/layer_10/intermediate/dense/mul_1, Execution Time: 0.001133 seconds
Node: bert/encoder/layer_10/intermediate/dense/Tanh, Execution Time: 0.001102 seconds
Node: bert/encoder/layer_10/intermediate/dense/add_1, Execution Time: 0.001111 seconds
Node: bert/encoder/layer_10/intermediate/dense/mul_2, Execution Time: 0.001147 seconds
Node: bert/encoder/layer_10/intermediate/dense/mul_3, Execution Time: 0.001394 seconds
Matmul Fuse Node: bert/encoder/layer_10/output/dense/MatMul, Execution Time: 0.004919 seconds
Node: bert/encoder/layer_10/output/LayerNorm/moments/mean, Execution Time: 0.000191 seconds
Node: bert/encoder/layer_10/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000257 seconds
Node: bert/encoder/layer_10/output/LayerNorm/moments/SquaredDifference__453, Execution Time: 0.000337 seconds
Node: bert/encoder/layer_10/output/LayerNorm/moments/variance, Execution Time: 0.000169 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/add, Execution Time: 0.000087 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/Rsqrt__455, Execution Time: 0.000080 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000093 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/sub, Execution Time: 0.000082 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000336 seconds
Node: bert/encoder/layer_10/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000426 seconds
Matmul Fuse Node: bert/encoder/layer_11/attention/self/value/MatMul, Execution Time: 0.002434 seconds
Node: bert/encoder/layer_11/attention/self/Reshape_2, Execution Time: 0.000021 seconds
Node: bert/encoder/layer_11/attention/self/transpose_2, Execution Time: 0.000255 seconds
Matmul Fuse Node: bert/encoder/layer_11/attention/self/query/MatMul, Execution Time: 0.002535 seconds
Node: bert/encoder/layer_11/attention/self/Reshape, Execution Time: 0.000016 seconds
Node: bert/encoder/layer_11/attention/self/transpose, Execution Time: 0.000252 seconds
Matmul Fuse Node: bert/encoder/layer_11/attention/self/key/MatMul, Execution Time: 0.002387 seconds
Node: bert/encoder/layer_11/attention/self/Reshape_1, Execution Time: 0.000015 seconds
Node: bert/encoder/layer_11/attention/self/MatMul__460, Execution Time: 0.000255 seconds
Node: bert/encoder/layer_11/attention/self/MatMul, Execution Time: 0.001323 seconds
Node: bert/encoder/layer_11/attention/self/Mul, Execution Time: 0.001202 seconds
Node: bert/encoder/layer_11/attention/self/add, Execution Time: 0.001811 seconds
Node: bert/encoder/layer_11/attention/self/Softmax, Execution Time: 0.001885 seconds
Node: bert/encoder/layer_11/attention/self/MatMul_1, Execution Time: 0.001011 seconds
Node: bert/encoder/layer_11/attention/self/transpose_3, Execution Time: 0.000238 seconds
Node: bert/encoder/layer_11/attention/self/Reshape_3, Execution Time: 0.000041 seconds
Matmul Fuse Node: bert/encoder/layer_11/attention/output/dense/MatMul, Execution Time: 0.002808 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/mean, Execution Time: 0.000190 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000253 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/SquaredDifference__463, Execution Time: 0.000549 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/moments/variance, Execution Time: 0.000167 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/add, Execution Time: 0.000085 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000059 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/Rsqrt__465, Execution Time: 0.000094 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul, Execution Time: 0.000091 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000079 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/sub, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000577 seconds
Node: bert/encoder/layer_11/attention/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000675 seconds
Matmul Fuse Node: bert/encoder/layer_11/intermediate/dense/MatMul, Execution Time: 0.003812 seconds
Node: bert/encoder/layer_11/intermediate/dense/Pow, Execution Time: 0.000718 seconds
Node: bert/encoder/layer_11/intermediate/dense/mul, Execution Time: 0.001158 seconds
Node: bert/encoder/layer_11/intermediate/dense/add, Execution Time: 0.001468 seconds
Node: bert/encoder/layer_11/intermediate/dense/mul_1, Execution Time: 0.001121 seconds
Node: bert/encoder/layer_11/intermediate/dense/Tanh, Execution Time: 0.001117 seconds
Node: bert/encoder/layer_11/intermediate/dense/add_1, Execution Time: 0.001119 seconds
Node: bert/encoder/layer_11/intermediate/dense/mul_2, Execution Time: 0.001112 seconds
Node: bert/encoder/layer_11/intermediate/dense/mul_3, Execution Time: 0.001389 seconds
Matmul Fuse Node: bert/encoder/layer_11/output/dense/MatMul, Execution Time: 0.004657 seconds
Node: bert/encoder/layer_11/output/LayerNorm/moments/mean, Execution Time: 0.000214 seconds
Node: bert/encoder/layer_11/output/LayerNorm/moments/SquaredDifference, Execution Time: 0.000257 seconds
Node: bert/encoder/layer_11/output/LayerNorm/moments/SquaredDifference__467, Execution Time: 0.000332 seconds
Node: bert/encoder/layer_11/output/LayerNorm/moments/variance, Execution Time: 0.000160 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/add, Execution Time: 0.000126 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/Rsqrt, Execution Time: 0.000069 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/Rsqrt__469, Execution Time: 0.000078 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul, Execution Time: 0.000084 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul_2, Execution Time: 0.000093 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/sub, Execution Time: 0.000081 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/mul_1, Execution Time: 0.000354 seconds
Node: bert/encoder/layer_11/output/LayerNorm/batchnorm/add_1, Execution Time: 0.000425 seconds
Matmul Fuse Node: MatMul, Execution Time: 0.003090 seconds
Node: Reshape_1, Execution Time: 0.000022 seconds
Node: transpose, Execution Time: 0.000084 seconds
Node: unstack, Execution Time: 0.000050 seconds
Node: unstack__490, Execution Time: 0.000005 seconds
Node: unstack__488, Execution Time: 0.000006 seconds

Total Execution Time: 0.699544 seconds

Total Matmul Fuse Execution Time: 0.270780 seconds
Execution complete.