Untitled
Total number of MatMul/Conv operations: 98 Total number of operations in the model: 753 ------------------------------------------------------------------------------------------------------------------ Total number of groups: 632 Average number of operations per group: 1.19 Total number of groups (excluding single-op groups): 85 Average number of operations per group (excluding single-op groups): 2.42 Total number of standalone OP groups: 547 ------------------------------------------------------------------------------------------------------------------ Group with the largest number of operations: Order: 50, OP Type: MatMul, Name: bert/encoder/layer_0/attention/self/MatMul Order: 51, OP Type: Mul, Name: bert/encoder/layer_0/attention/self/Mul Order: 52, OP Type: Add, Name: bert/encoder/layer_0/attention/self/add Total operations in this group: 3 ------------------------------------------------------------------------------------------------------------------ Kernel (but not elementwise) operation breakdown: 180 Cast: 4 Slice: 1 Squeeze: 3 Unsqueeze: 1 Concat: 1 ConstantOfShape: 1 Reshape: 56 Gather: 1 ReduceMean: 50 Transpose: 49 Softmax: 12 Split: 1 Elementwise operation breakdown: 472 Mul: 162 Sub: 51 Add: 185 Sqrt: 25 Reciprocal: 25 Pow: 12 Tanh: 12 ------------------------------------------------------------------------------------------------------------------ Statistics of operations in groups with more than one operation: Total operations in non-single-op groups: 206 Operation breakdown: MatMul: 85 Add: 109 Mul: 12 ------------------------------------------------------------------------------------------------------------------ Stopping Reasons for Following Paths: Non-elementwise stops: 62 Multiple output stops: 36 Matmul/Conv stops: 0
Leave a Comment