Untitled
Total number of MatMul/Conv operations: 97 Total number of operations in the model: 626 ------------------------------------------------------------------------------------------------------------------ Total number of groups: 505 Average number of operations per group: 1.24 Total number of groups (excluding single-op groups): 85 Average number of operations per group (excluding single-op groups): 2.42 Total number of standalone OP groups: 420 ------------------------------------------------------------------------------------------------------------------ Group with the largest number of operations: Order: 35, OP Type: MatMul, Name: /encoder/layer.0/attention/self/MatMul Order: 36, OP Type: Div, Name: /encoder/layer.0/attention/self/Div Order: 37, OP Type: Add, Name: /encoder/layer.0/attention/self/Add Total operations in this group: 3 ------------------------------------------------------------------------------------------------------------------ Kernel (but not elementwise) operation breakdown: 164 Unsqueeze: 1 Cast: 2 Gather: 3 ReduceMean: 50 Reshape: 48 Transpose: 48 Softmax: 12 Elementwise operation breakdown: 364 Sub: 26 Mul: 51 Equal: 1 Not: 1 Add: 173 Pow: 25 Sqrt: 25 Div: 49 Erf: 12 Tanh: 1 ------------------------------------------------------------------------------------------------------------------ Statistics of operations in groups with more than one operation: Total operations in non-single-op groups: 206 Operation breakdown: MatMul: 84 Add: 108 Div: 12 Gemm: 1 Tanh: 1 ------------------------------------------------------------------------------------------------------------------ Stopping Reasons for Following Paths: Non-elementwise stops: 60 Multiple output stops: 36 Matmul/Conv stops: 0
Leave a Comment