Untitled
Total number of MatMul/Conv operations: 74 Total number of operations in the model: 767 ------------------------------------------------------------------------------------------------------------------ Total number of groups: 719 Average number of operations per group: 1.07 Total number of groups (excluding single-op groups): 36 Average number of operations per group (excluding single-op groups): 2.33 Total number of standalone OP groups: 683 ------------------------------------------------------------------------------------------------------------------ Group with the largest number of operations: Order: 71, OP Type: MatMul, Name: /encoder/layers/encoder_layer_0/mlp/mlp.3/MatMul Order: 72, OP Type: Add, Name: /encoder/layers/encoder_layer_0/mlp/mlp.3/Add Order: 73, OP Type: Add, Name: /encoder/layers/encoder_layer_0/Add_1 Total operations in this group: 3 ------------------------------------------------------------------------------------------------------------------ Kernel (but not elementwise) operation breakdown: 359 Reshape: 109 Transpose: 97 Gather: 38 Unsqueeze: 13 Concat: 14 Where: 1 Expand: 1 ReduceMean: 50 Slice: 12 Squeeze: 12 Softmax: 12 Elementwise operation breakdown: 321 Equal: 1 Add: 123 Sub: 25 Pow: 25 Sqrt: 25 Div: 37 Mul: 73 Erf: 12 ------------------------------------------------------------------------------------------------------------------ Statistics of operations in groups with more than one operation: Total operations in non-single-op groups: 84 Operation breakdown: MatMul: 36 Add: 48 ------------------------------------------------------------------------------------------------------------------ Stopping Reasons for Following Paths: Non-elementwise stops: 37 Multiple output stops: 36 Matmul/Conv stops: 0
Leave a Comment