Untitled
Group 1: Order: 0, OP Type: Unsqueeze, Name: /Unsqueeze_1 Group 2: Order: 1, OP Type: Sub, Name: /Sub Group 3: Order: 2, OP Type: Mul, Name: /Mul_1 Group 4: Order: 3, OP Type: Equal, Name: /embeddings/Equal Group 5: Order: 4, OP Type: Not, Name: /embeddings/Not Group 6: Order: 5, OP Type: Cast, Name: /embeddings/Cast Group 7: Order: 6, OP Type: CumSum, Name: /embeddings/CumSum Group 8: Order: 7, OP Type: Mul, Name: /embeddings/Mul Group 9: Order: 8, OP Type: Cast, Name: /embeddings/Cast_1 Group 10: Order: 9, OP Type: Add, Name: /embeddings/Add Group 11: Order: 10, OP Type: Gather, Name: /embeddings/word_embeddings/Gather Group 12: Order: 11, OP Type: Add, Name: /embeddings/Add_1 Group 13: Order: 12, OP Type: Gather, Name: /embeddings/position_embeddings/Gather Group 14: Order: 13, OP Type: Add, Name: /embeddings/Add_2 Group 15: Order: 14, OP Type: ReduceMean, Name: /embeddings/LayerNorm/ReduceMean Group 16: Order: 15, OP Type: Sub, Name: /embeddings/LayerNorm/Sub Group 17: Order: 16, OP Type: Pow, Name: /embeddings/LayerNorm/Pow Group 18: Order: 17, OP Type: ReduceMean, Name: /embeddings/LayerNorm/ReduceMean_1 Group 19: Order: 18, OP Type: Add, Name: /embeddings/LayerNorm/Add Group 20: Order: 19, OP Type: Sqrt, Name: /embeddings/LayerNorm/Sqrt Group 21: Order: 20, OP Type: Div, Name: /embeddings/LayerNorm/Div Group 22: Order: 21, OP Type: Mul, Name: /embeddings/LayerNorm/Mul Group 23: Order: 22, OP Type: Add, Name: /embeddings/LayerNorm/Add_1 Group 24: Order: 23, OP Type: MatMul, Name: /encoder/layer.0/attention/self/query/MatMul Order: 24, OP Type: Add, Name: /encoder/layer.0/attention/self/query/Add Group 25: Order: 25, OP Type: MatMul, Name: /encoder/layer.0/attention/self/key/MatMul Order: 26, OP Type: Add, Name: /encoder/layer.0/attention/self/key/Add Group 26: Order: 27, OP Type: Reshape, Name: /encoder/layer.0/attention/self/Reshape Group 27: Order: 28, OP Type: MatMul, Name: /encoder/layer.0/attention/self/value/MatMul Order: 29, OP Type: Add, Name: /encoder/layer.0/attention/self/value/Add Group 28: Order: 30, OP Type: Reshape, Name: /encoder/layer.0/attention/self/Reshape_1 Group 29: Order: 31, OP Type: Transpose, Name: /encoder/layer.0/attention/self/Transpose Group 30: Order: 32, OP Type: Reshape, Name: /encoder/layer.0/attention/self/Reshape_2 Group 31: Order: 33, OP Type: Transpose, Name: /encoder/layer.0/attention/self/Transpose_1 Group 32: Order: 34, OP Type: Transpose, Name: /encoder/layer.0/attention/self/Transpose_2 Group 33: Order: 35, OP Type: MatMul, Name: /encoder/layer.0/attention/self/MatMul Order: 36, OP Type: Div, Name: /encoder/layer.0/attention/self/Div Order: 37, OP Type: Add, Name: /encoder/layer.0/attention/self/Add Group 34: Order: 38, OP Type: Softmax, Name: /encoder/layer.0/attention/self/Softmax Group 35: Order: 39, OP Type: MatMul, Name: /encoder/layer.0/attention/self/MatMul_1 Group 36: Order: 40, OP Type: Transpose, Name: /encoder/layer.0/attention/self/Transpose_3 Group 37: Order: 41, OP Type: Reshape, Name: /encoder/layer.0/attention/self/Reshape_3 Group 38: Order: 42, OP Type: MatMul, Name: /encoder/layer.0/attention/output/dense/MatMul Order: 43, OP Type: Add, Name: /encoder/layer.0/attention/output/dense/Add Order: 44, OP Type: Add, Name: /encoder/layer.0/attention/output/Add Group 39: Order: 45, OP Type: ReduceMean, Name: /encoder/layer.0/attention/output/LayerNorm/ReduceMean Group 40: Order: 46, OP Type: Sub, Name: /encoder/layer.0/attention/output/LayerNorm/Sub Group 41: Order: 47, OP Type: Pow, Name: /encoder/layer.0/attention/output/LayerNorm/Pow Group 42: Order: 48, OP Type: ReduceMean, Name: /encoder/layer.0/attention/output/LayerNorm/ReduceMean_1 Group 43: Order: 49, OP Type: Add, Name: /encoder/layer.0/attention/output/LayerNorm/Add Group 44: Order: 50, OP Type: Sqrt, Name: /encoder/layer.0/attention/output/LayerNorm/Sqrt Group 45: Order: 51, OP Type: Div, Name: /encoder/layer.0/attention/output/LayerNorm/Div Group 46: Order: 52, OP Type: Mul, Name: /encoder/layer.0/attention/output/LayerNorm/Mul Group 47: Order: 53, OP Type: Add, Name: /encoder/layer.0/attention/output/LayerNorm/Add_1 Group 48: Order: 54, OP Type: MatMul, Name: /encoder/layer.0/intermediate/dense/MatMul Order: 55, OP Type: Add, Name: /encoder/layer.0/intermediate/dense/Add Group 49: Order: 56, OP Type: Div, Name: /encoder/layer.0/intermediate/intermediate_act_fn/Div Group 50: Order: 57, OP Type: Erf, Name: /encoder/layer.0/intermediate/intermediate_act_fn/Erf Group 51: Order: 58, OP Type: Add, Name: /encoder/layer.0/intermediate/intermediate_act_fn/Add Group 52: Order: 59, OP Type: Mul, Name: /encoder/layer.0/intermediate/intermediate_act_fn/Mul Group 53: Order: 60, OP Type: Mul, Name: /encoder/layer.0/intermediate/intermediate_act_fn/Mul_1 Group 54: Order: 61, OP Type: MatMul, Name: /encoder/layer.0/output/dense/MatMul Order: 62, OP Type: Add, Name: /encoder/layer.0/output/dense/Add Order: 63, OP Type: Add, Name: /encoder/layer.0/output/Add Group 55: Order: 64, OP Type: ReduceMean, Name: /encoder/layer.0/output/LayerNorm/ReduceMean Group 56: Order: 65, OP Type: Sub, Name: /encoder/layer.0/output/LayerNorm/Sub Group 57: Order: 66, OP Type: Pow, Name: /encoder/layer.0/output/LayerNorm/Pow Group 58: Order: 67, OP Type: ReduceMean, Name: /encoder/layer.0/output/LayerNorm/ReduceMean_1 Group 59: Order: 68, OP Type: Add, Name: /encoder/layer.0/output/LayerNorm/Add Group 60: Order: 69, OP Type: Sqrt, Name: /encoder/layer.0/output/LayerNorm/Sqrt Group 61: Order: 70, OP Type: Div, Name: /encoder/layer.0/output/LayerNorm/Div Group 62: Order: 71, OP Type: Mul, Name: /encoder/layer.0/output/LayerNorm/Mul Group 63: Order: 72, OP Type: Add, Name: /encoder/layer.0/output/LayerNorm/Add_1 Group 64: Order: 73, OP Type: MatMul, Name: /encoder/layer.1/attention/self/query/MatMul Order: 74, OP Type: Add, Name: /encoder/layer.1/attention/self/query/Add Group 65: Order: 75, OP Type: MatMul, Name: /encoder/layer.1/attention/self/key/MatMul Order: 76, OP Type: Add, Name: /encoder/layer.1/attention/self/key/Add Group 66: Order: 77, OP Type: Reshape, Name: /encoder/layer.1/attention/self/Reshape Group 67: Order: 78, OP Type: MatMul, Name: /encoder/layer.1/attention/self/value/MatMul Order: 79, OP Type: Add, Name: /encoder/layer.1/attention/self/value/Add Group 68: Order: 80, OP Type: Reshape, Name: /encoder/layer.1/attention/self/Reshape_1 Group 69: Order: 81, OP Type: Transpose, Name: /encoder/layer.1/attention/self/Transpose Group 70: Order: 82, OP Type: Reshape, Name: /encoder/layer.1/attention/self/Reshape_2 Group 71: Order: 83, OP Type: Transpose, Name: /encoder/layer.1/attention/self/Transpose_1 Group 72: Order: 84, OP Type: Transpose, Name: /encoder/layer.1/attention/self/Transpose_2 Group 73: Order: 85, OP Type: MatMul, Name: /encoder/layer.1/attention/self/MatMul Order: 86, OP Type: Div, Name: /encoder/layer.1/attention/self/Div Order: 87, OP Type: Add, Name: /encoder/layer.1/attention/self/Add Group 74: Order: 88, OP Type: Softmax, Name: /encoder/layer.1/attention/self/Softmax Group 75: Order: 89, OP Type: MatMul, Name: /encoder/layer.1/attention/self/MatMul_1 Group 76: Order: 90, OP Type: Transpose, Name: /encoder/layer.1/attention/self/Transpose_3 Group 77: Order: 91, OP Type: Reshape, Name: /encoder/layer.1/attention/self/Reshape_3 Group 78: Order: 92, OP Type: MatMul, Name: /encoder/layer.1/attention/output/dense/MatMul Order: 93, OP Type: Add, Name: /encoder/layer.1/attention/output/dense/Add Order: 94, OP Type: Add, Name: /encoder/layer.1/attention/output/Add Group 79: Order: 95, OP Type: ReduceMean, Name: /encoder/layer.1/attention/output/LayerNorm/ReduceMean Group 80: Order: 96, OP Type: Sub, Name: /encoder/layer.1/attention/output/LayerNorm/Sub Group 81: Order: 97, OP Type: Pow, Name: /encoder/layer.1/attention/output/LayerNorm/Pow Group 82: Order: 98, OP Type: ReduceMean, Name: /encoder/layer.1/attention/output/LayerNorm/ReduceMean_1 Group 83: Order: 99, OP Type: Add, Name: /encoder/layer.1/attention/output/LayerNorm/Add Group 84: Order: 100, OP Type: Sqrt, Name: /encoder/layer.1/attention/output/LayerNorm/Sqrt Group 85: Order: 101, OP Type: Div, Name: /encoder/layer.1/attention/output/LayerNorm/Div Group 86: Order: 102, OP Type: Mul, Name: /encoder/layer.1/attention/output/LayerNorm/Mul Group 87: Order: 103, OP Type: Add, Name: /encoder/layer.1/attention/output/LayerNorm/Add_1 Group 88: Order: 104, OP Type: MatMul, Name: /encoder/layer.1/intermediate/dense/MatMul Order: 105, OP Type: Add, Name: /encoder/layer.1/intermediate/dense/Add Group 89: Order: 106, OP Type: Div, Name: /encoder/layer.1/intermediate/intermediate_act_fn/Div Group 90: Order: 107, OP Type: Erf, Name: /encoder/layer.1/intermediate/intermediate_act_fn/Erf Group 91: Order: 108, OP Type: Add, Name: /encoder/layer.1/intermediate/intermediate_act_fn/Add Group 92: Order: 109, OP Type: Mul, Name: /encoder/layer.1/intermediate/intermediate_act_fn/Mul Group 93: Order: 110, OP Type: Mul, Name: /encoder/layer.1/intermediate/intermediate_act_fn/Mul_1 Group 94: Order: 111, OP Type: MatMul, Name: /encoder/layer.1/output/dense/MatMul Order: 112, OP Type: Add, Name: /encoder/layer.1/output/dense/Add Order: 113, OP Type: Add, Name: /encoder/layer.1/output/Add Group 95: Order: 114, OP Type: ReduceMean, Name: /encoder/layer.1/output/LayerNorm/ReduceMean Group 96: Order: 115, OP Type: Sub, Name: /encoder/layer.1/output/LayerNorm/Sub Group 97: Order: 116, OP Type: Pow, Name: /encoder/layer.1/output/LayerNorm/Pow Group 98: Order: 117, OP Type: ReduceMean, Name: /encoder/layer.1/output/LayerNorm/ReduceMean_1 Group 99: Order: 118, OP Type: Add, Name: /encoder/layer.1/output/LayerNorm/Add Group 100: Order: 119, OP Type: Sqrt, Name: /encoder/layer.1/output/LayerNorm/Sqrt Group 101: Order: 120, OP Type: Div, Name: /encoder/layer.1/output/LayerNorm/Div Group 102: Order: 121, OP Type: Mul, Name: /encoder/layer.1/output/LayerNorm/Mul Group 103: Order: 122, OP Type: Add, Name: /encoder/layer.1/output/LayerNorm/Add_1 Group 104: Order: 123, OP Type: MatMul, Name: /encoder/layer.2/attention/self/query/MatMul Order: 124, OP Type: Add, Name: /encoder/layer.2/attention/self/query/Add Group 105: Order: 125, OP Type: MatMul, Name: /encoder/layer.2/attention/self/key/MatMul Order: 126, OP Type: Add, Name: /encoder/layer.2/attention/self/key/Add Group 106: Order: 127, OP Type: Reshape, Name: /encoder/layer.2/attention/self/Reshape Group 107: Order: 128, OP Type: MatMul, Name: /encoder/layer.2/attention/self/value/MatMul Order: 129, OP Type: Add, Name: /encoder/layer.2/attention/self/value/Add Group 108: Order: 130, OP Type: Reshape, Name: /encoder/layer.2/attention/self/Reshape_1 Group 109: Order: 131, OP Type: Transpose, Name: /encoder/layer.2/attention/self/Transpose Group 110: Order: 132, OP Type: Reshape, Name: /encoder/layer.2/attention/self/Reshape_2 Group 111: Order: 133, OP Type: Transpose, Name: /encoder/layer.2/attention/self/Transpose_1 Group 112: Order: 134, OP Type: Transpose, Name: /encoder/layer.2/attention/self/Transpose_2 Group 113: Order: 135, OP Type: MatMul, Name: /encoder/layer.2/attention/self/MatMul Order: 136, OP Type: Div, Name: /encoder/layer.2/attention/self/Div Order: 137, OP Type: Add, Name: /encoder/layer.2/attention/self/Add Group 114: Order: 138, OP Type: Softmax, Name: /encoder/layer.2/attention/self/Softmax Group 115: Order: 139, OP Type: MatMul, Name: /encoder/layer.2/attention/self/MatMul_1 Group 116: Order: 140, OP Type: Transpose, Name: /encoder/layer.2/attention/self/Transpose_3 Group 117: Order: 141, OP Type: Reshape, Name: /encoder/layer.2/attention/self/Reshape_3 Group 118: Order: 142, OP Type: MatMul, Name: /encoder/layer.2/attention/output/dense/MatMul Order: 143, OP Type: Add, Name: /encoder/layer.2/attention/output/dense/Add Order: 144, OP Type: Add, Name: /encoder/layer.2/attention/output/Add Group 119: Order: 145, OP Type: ReduceMean, Name: /encoder/layer.2/attention/output/LayerNorm/ReduceMean Group 120: Order: 146, OP Type: Sub, Name: /encoder/layer.2/attention/output/LayerNorm/Sub Group 121: Order: 147, OP Type: Pow, Name: /encoder/layer.2/attention/output/LayerNorm/Pow Group 122: Order: 148, OP Type: ReduceMean, Name: /encoder/layer.2/attention/output/LayerNorm/ReduceMean_1 Group 123: Order: 149, OP Type: Add, Name: /encoder/layer.2/attention/output/LayerNorm/Add Group 124: Order: 150, OP Type: Sqrt, Name: /encoder/layer.2/attention/output/LayerNorm/Sqrt Group 125: Order: 151, OP Type: Div, Name: /encoder/layer.2/attention/output/LayerNorm/Div Group 126: Order: 152, OP Type: Mul, Name: /encoder/layer.2/attention/output/LayerNorm/Mul Group 127: Order: 153, OP Type: Add, Name: /encoder/layer.2/attention/output/LayerNorm/Add_1 Group 128: Order: 154, OP Type: MatMul, Name: /encoder/layer.2/intermediate/dense/MatMul Order: 155, OP Type: Add, Name: /encoder/layer.2/intermediate/dense/Add Group 129: Order: 156, OP Type: Div, Name: /encoder/layer.2/intermediate/intermediate_act_fn/Div Group 130: Order: 157, OP Type: Erf, Name: /encoder/layer.2/intermediate/intermediate_act_fn/Erf Group 131: Order: 158, OP Type: Add, Name: /encoder/layer.2/intermediate/intermediate_act_fn/Add Group 132: Order: 159, OP Type: Mul, Name: /encoder/layer.2/intermediate/intermediate_act_fn/Mul Group 133: Order: 160, OP Type: Mul, Name: /encoder/layer.2/intermediate/intermediate_act_fn/Mul_1 Group 134: Order: 161, OP Type: MatMul, Name: /encoder/layer.2/output/dense/MatMul Order: 162, OP Type: Add, Name: /encoder/layer.2/output/dense/Add Order: 163, OP Type: Add, Name: /encoder/layer.2/output/Add Group 135: Order: 164, OP Type: ReduceMean, Name: /encoder/layer.2/output/LayerNorm/ReduceMean Group 136: Order: 165, OP Type: Sub, Name: /encoder/layer.2/output/LayerNorm/Sub Group 137: Order: 166, OP Type: Pow, Name: /encoder/layer.2/output/LayerNorm/Pow Group 138: Order: 167, OP Type: ReduceMean, Name: /encoder/layer.2/output/LayerNorm/ReduceMean_1 Group 139: Order: 168, OP Type: Add, Name: /encoder/layer.2/output/LayerNorm/Add Group 140: Order: 169, OP Type: Sqrt, Name: /encoder/layer.2/output/LayerNorm/Sqrt Group 141: Order: 170, OP Type: Div, Name: /encoder/layer.2/output/LayerNorm/Div Group 142: Order: 171, OP Type: Mul, Name: /encoder/layer.2/output/LayerNorm/Mul Group 143: Order: 172, OP Type: Add, Name: /encoder/layer.2/output/LayerNorm/Add_1 Group 144: Order: 173, OP Type: MatMul, Name: /encoder/layer.3/attention/self/query/MatMul Order: 174, OP Type: Add, Name: /encoder/layer.3/attention/self/query/Add Group 145: Order: 175, OP Type: MatMul, Name: /encoder/layer.3/attention/self/key/MatMul Order: 176, OP Type: Add, Name: /encoder/layer.3/attention/self/key/Add Group 146: Order: 177, OP Type: Reshape, Name: /encoder/layer.3/attention/self/Reshape Group 147: Order: 178, OP Type: MatMul, Name: /encoder/layer.3/attention/self/value/MatMul Order: 179, OP Type: Add, Name: /encoder/layer.3/attention/self/value/Add Group 148: Order: 180, OP Type: Reshape, Name: /encoder/layer.3/attention/self/Reshape_1 Group 149: Order: 181, OP Type: Transpose, Name: /encoder/layer.3/attention/self/Transpose Group 150: Order: 182, OP Type: Reshape, Name: /encoder/layer.3/attention/self/Reshape_2 Group 151: Order: 183, OP Type: Transpose, Name: /encoder/layer.3/attention/self/Transpose_1 Group 152: Order: 184, OP Type: Transpose, Name: /encoder/layer.3/attention/self/Transpose_2 Group 153: Order: 185, OP Type: MatMul, Name: /encoder/layer.3/attention/self/MatMul Order: 186, OP Type: Div, Name: /encoder/layer.3/attention/self/Div Order: 187, OP Type: Add, Name: /encoder/layer.3/attention/self/Add Group 154: Order: 188, OP Type: Softmax, Name: /encoder/layer.3/attention/self/Softmax Group 155: Order: 189, OP Type: MatMul, Name: /encoder/layer.3/attention/self/MatMul_1 Group 156: Order: 190, OP Type: Transpose, Name: /encoder/layer.3/attention/self/Transpose_3 Group 157: Order: 191, OP Type: Reshape, Name: /encoder/layer.3/attention/self/Reshape_3 Group 158: Order: 192, OP Type: MatMul, Name: /encoder/layer.3/attention/output/dense/MatMul Order: 193, OP Type: Add, Name: /encoder/layer.3/attention/output/dense/Add Order: 194, OP Type: Add, Name: /encoder/layer.3/attention/output/Add Group 159: Order: 195, OP Type: ReduceMean, Name: /encoder/layer.3/attention/output/LayerNorm/ReduceMean Group 160: Order: 196, OP Type: Sub, Name: /encoder/layer.3/attention/output/LayerNorm/Sub Group 161: Order: 197, OP Type: Pow, Name: /encoder/layer.3/attention/output/LayerNorm/Pow Group 162: Order: 198, OP Type: ReduceMean, Name: /encoder/layer.3/attention/output/LayerNorm/ReduceMean_1 Group 163: Order: 199, OP Type: Add, Name: /encoder/layer.3/attention/output/LayerNorm/Add Group 164: Order: 200, OP Type: Sqrt, Name: /encoder/layer.3/attention/output/LayerNorm/Sqrt Group 165: Order: 201, OP Type: Div, Name: /encoder/layer.3/attention/output/LayerNorm/Div Group 166: Order: 202, OP Type: Mul, Name: /encoder/layer.3/attention/output/LayerNorm/Mul Group 167: Order: 203, OP Type: Add, Name: /encoder/layer.3/attention/output/LayerNorm/Add_1 Group 168: Order: 204, OP Type: MatMul, Name: /encoder/layer.3/intermediate/dense/MatMul Order: 205, OP Type: Add, Name: /encoder/layer.3/intermediate/dense/Add Group 169: Order: 206, OP Type: Div, Name: /encoder/layer.3/intermediate/intermediate_act_fn/Div Group 170: Order: 207, OP Type: Erf, Name: /encoder/layer.3/intermediate/intermediate_act_fn/Erf Group 171: Order: 208, OP Type: Add, Name: /encoder/layer.3/intermediate/intermediate_act_fn/Add Group 172: Order: 209, OP Type: Mul, Name: /encoder/layer.3/intermediate/intermediate_act_fn/Mul Group 173: Order: 210, OP Type: Mul, Name: /encoder/layer.3/intermediate/intermediate_act_fn/Mul_1 Group 174: Order: 211, OP Type: MatMul, Name: /encoder/layer.3/output/dense/MatMul Order: 212, OP Type: Add, Name: /encoder/layer.3/output/dense/Add Order: 213, OP Type: Add, Name: /encoder/layer.3/output/Add Group 175: Order: 214, OP Type: ReduceMean, Name: /encoder/layer.3/output/LayerNorm/ReduceMean Group 176: Order: 215, OP Type: Sub, Name: /encoder/layer.3/output/LayerNorm/Sub Group 177: Order: 216, OP Type: Pow, Name: /encoder/layer.3/output/LayerNorm/Pow Group 178: Order: 217, OP Type: ReduceMean, Name: /encoder/layer.3/output/LayerNorm/ReduceMean_1 Group 179: Order: 218, OP Type: Add, Name: /encoder/layer.3/output/LayerNorm/Add Group 180: Order: 219, OP Type: Sqrt, Name: /encoder/layer.3/output/LayerNorm/Sqrt Group 181: Order: 220, OP Type: Div, Name: /encoder/layer.3/output/LayerNorm/Div Group 182: Order: 221, OP Type: Mul, Name: /encoder/layer.3/output/LayerNorm/Mul Group 183: Order: 222, OP Type: Add, Name: /encoder/layer.3/output/LayerNorm/Add_1 Group 184: Order: 223, OP Type: MatMul, Name: /encoder/layer.4/attention/self/query/MatMul Order: 224, OP Type: Add, Name: /encoder/layer.4/attention/self/query/Add Group 185: Order: 225, OP Type: MatMul, Name: /encoder/layer.4/attention/self/key/MatMul Order: 226, OP Type: Add, Name: /encoder/layer.4/attention/self/key/Add Group 186: Order: 227, OP Type: Reshape, Name: /encoder/layer.4/attention/self/Reshape Group 187: Order: 228, OP Type: MatMul, Name: /encoder/layer.4/attention/self/value/MatMul Order: 229, OP Type: Add, Name: /encoder/layer.4/attention/self/value/Add Group 188: Order: 230, OP Type: Reshape, Name: /encoder/layer.4/attention/self/Reshape_1 Group 189: Order: 231, OP Type: Transpose, Name: /encoder/layer.4/attention/self/Transpose Group 190: Order: 232, OP Type: Reshape, Name: /encoder/layer.4/attention/self/Reshape_2 Group 191: Order: 233, OP Type: Transpose, Name: /encoder/layer.4/attention/self/Transpose_1 Group 192: Order: 234, OP Type: Transpose, Name: /encoder/layer.4/attention/self/Transpose_2 Group 193: Order: 235, OP Type: MatMul, Name: /encoder/layer.4/attention/self/MatMul Order: 236, OP Type: Div, Name: /encoder/layer.4/attention/self/Div Order: 237, OP Type: Add, Name: /encoder/layer.4/attention/self/Add Group 194: Order: 238, OP Type: Softmax, Name: /encoder/layer.4/attention/self/Softmax Group 195: Order: 239, OP Type: MatMul, Name: /encoder/layer.4/attention/self/MatMul_1 Group 196: Order: 240, OP Type: Transpose, Name: /encoder/layer.4/attention/self/Transpose_3 Group 197: Order: 241, OP Type: Reshape, Name: /encoder/layer.4/attention/self/Reshape_3 Group 198: Order: 242, OP Type: MatMul, Name: /encoder/layer.4/attention/output/dense/MatMul Order: 243, OP Type: Add, Name: /encoder/layer.4/attention/output/dense/Add Order: 244, OP Type: Add, Name: /encoder/layer.4/attention/output/Add Group 199: Order: 245, OP Type: ReduceMean, Name: /encoder/layer.4/attention/output/LayerNorm/ReduceMean Group 200: Order: 246, OP Type: Sub, Name: /encoder/layer.4/attention/output/LayerNorm/Sub Group 201: Order: 247, OP Type: Pow, Name: /encoder/layer.4/attention/output/LayerNorm/Pow Group 202: Order: 248, OP Type: ReduceMean, Name: /encoder/layer.4/attention/output/LayerNorm/ReduceMean_1 Group 203: Order: 249, OP Type: Add, Name: /encoder/layer.4/attention/output/LayerNorm/Add Group 204: Order: 250, OP Type: Sqrt, Name: /encoder/layer.4/attention/output/LayerNorm/Sqrt Group 205: Order: 251, OP Type: Div, Name: /encoder/layer.4/attention/output/LayerNorm/Div Group 206: Order: 252, OP Type: Mul, Name: /encoder/layer.4/attention/output/LayerNorm/Mul Group 207: Order: 253, OP Type: Add, Name: /encoder/layer.4/attention/output/LayerNorm/Add_1 Group 208: Order: 254, OP Type: MatMul, Name: /encoder/layer.4/intermediate/dense/MatMul Order: 255, OP Type: Add, Name: /encoder/layer.4/intermediate/dense/Add Group 209: Order: 256, OP Type: Div, Name: /encoder/layer.4/intermediate/intermediate_act_fn/Div Group 210: Order: 257, OP Type: Erf, Name: /encoder/layer.4/intermediate/intermediate_act_fn/Erf Group 211: Order: 258, OP Type: Add, Name: /encoder/layer.4/intermediate/intermediate_act_fn/Add Group 212: Order: 259, OP Type: Mul, Name: /encoder/layer.4/intermediate/intermediate_act_fn/Mul Group 213: Order: 260, OP Type: Mul, Name: /encoder/layer.4/intermediate/intermediate_act_fn/Mul_1 Group 214: Order: 261, OP Type: MatMul, Name: /encoder/layer.4/output/dense/MatMul Order: 262, OP Type: Add, Name: /encoder/layer.4/output/dense/Add Order: 263, OP Type: Add, Name: /encoder/layer.4/output/Add Group 215: Order: 264, OP Type: ReduceMean, Name: /encoder/layer.4/output/LayerNorm/ReduceMean Group 216: Order: 265, OP Type: Sub, Name: /encoder/layer.4/output/LayerNorm/Sub Group 217: Order: 266, OP Type: Pow, Name: /encoder/layer.4/output/LayerNorm/Pow Group 218: Order: 267, OP Type: ReduceMean, Name: /encoder/layer.4/output/LayerNorm/ReduceMean_1 Group 219: Order: 268, OP Type: Add, Name: /encoder/layer.4/output/LayerNorm/Add Group 220: Order: 269, OP Type: Sqrt, Name: /encoder/layer.4/output/LayerNorm/Sqrt Group 221: Order: 270, OP Type: Div, Name: /encoder/layer.4/output/LayerNorm/Div Group 222: Order: 271, OP Type: Mul, Name: /encoder/layer.4/output/LayerNorm/Mul Group 223: Order: 272, OP Type: Add, Name: /encoder/layer.4/output/LayerNorm/Add_1 Group 224: Order: 273, OP Type: MatMul, Name: /encoder/layer.5/attention/self/query/MatMul Order: 274, OP Type: Add, Name: /encoder/layer.5/attention/self/query/Add Group 225: Order: 275, OP Type: MatMul, Name: /encoder/layer.5/attention/self/key/MatMul Order: 276, OP Type: Add, Name: /encoder/layer.5/attention/self/key/Add Group 226: Order: 277, OP Type: Reshape, Name: /encoder/layer.5/attention/self/Reshape Group 227: Order: 278, OP Type: MatMul, Name: /encoder/layer.5/attention/self/value/MatMul Order: 279, OP Type: Add, Name: /encoder/layer.5/attention/self/value/Add Group 228: Order: 280, OP Type: Reshape, Name: /encoder/layer.5/attention/self/Reshape_1 Group 229: Order: 281, OP Type: Transpose, Name: /encoder/layer.5/attention/self/Transpose Group 230: Order: 282, OP Type: Reshape, Name: /encoder/layer.5/attention/self/Reshape_2 Group 231: Order: 283, OP Type: Transpose, Name: /encoder/layer.5/attention/self/Transpose_1 Group 232: Order: 284, OP Type: Transpose, Name: /encoder/layer.5/attention/self/Transpose_2 Group 233: Order: 285, OP Type: MatMul, Name: /encoder/layer.5/attention/self/MatMul Order: 286, OP Type: Div, Name: /encoder/layer.5/attention/self/Div Order: 287, OP Type: Add, Name: /encoder/layer.5/attention/self/Add Group 234: Order: 288, OP Type: Softmax, Name: /encoder/layer.5/attention/self/Softmax Group 235: Order: 289, OP Type: MatMul, Name: /encoder/layer.5/attention/self/MatMul_1 Group 236: Order: 290, OP Type: Transpose, Name: /encoder/layer.5/attention/self/Transpose_3 Group 237: Order: 291, OP Type: Reshape, Name: /encoder/layer.5/attention/self/Reshape_3 Group 238: Order: 292, OP Type: MatMul, Name: /encoder/layer.5/attention/output/dense/MatMul Order: 293, OP Type: Add, Name: /encoder/layer.5/attention/output/dense/Add Order: 294, OP Type: Add, Name: /encoder/layer.5/attention/output/Add Group 239: Order: 295, OP Type: ReduceMean, Name: /encoder/layer.5/attention/output/LayerNorm/ReduceMean Group 240: Order: 296, OP Type: Sub, Name: /encoder/layer.5/attention/output/LayerNorm/Sub Group 241: Order: 297, OP Type: Pow, Name: /encoder/layer.5/attention/output/LayerNorm/Pow Group 242: Order: 298, OP Type: ReduceMean, Name: /encoder/layer.5/attention/output/LayerNorm/ReduceMean_1 Group 243: Order: 299, OP Type: Add, Name: /encoder/layer.5/attention/output/LayerNorm/Add Group 244: Order: 300, OP Type: Sqrt, Name: /encoder/layer.5/attention/output/LayerNorm/Sqrt Group 245: Order: 301, OP Type: Div, Name: /encoder/layer.5/attention/output/LayerNorm/Div Group 246: Order: 302, OP Type: Mul, Name: /encoder/layer.5/attention/output/LayerNorm/Mul Group 247: Order: 303, OP Type: Add, Name: /encoder/layer.5/attention/output/LayerNorm/Add_1 Group 248: Order: 304, OP Type: MatMul, Name: /encoder/layer.5/intermediate/dense/MatMul Order: 305, OP Type: Add, Name: /encoder/layer.5/intermediate/dense/Add Group 249: Order: 306, OP Type: Div, Name: /encoder/layer.5/intermediate/intermediate_act_fn/Div Group 250: Order: 307, OP Type: Erf, Name: /encoder/layer.5/intermediate/intermediate_act_fn/Erf Group 251: Order: 308, OP Type: Add, Name: /encoder/layer.5/intermediate/intermediate_act_fn/Add Group 252: Order: 309, OP Type: Mul, Name: /encoder/layer.5/intermediate/intermediate_act_fn/Mul Group 253: Order: 310, OP Type: Mul, Name: /encoder/layer.5/intermediate/intermediate_act_fn/Mul_1 Group 254: Order: 311, OP Type: MatMul, Name: /encoder/layer.5/output/dense/MatMul Order: 312, OP Type: Add, Name: /encoder/layer.5/output/dense/Add Order: 313, OP Type: Add, Name: /encoder/layer.5/output/Add Group 255: Order: 314, OP Type: ReduceMean, Name: /encoder/layer.5/output/LayerNorm/ReduceMean Group 256: Order: 315, OP Type: Sub, Name: /encoder/layer.5/output/LayerNorm/Sub Group 257: Order: 316, OP Type: Pow, Name: /encoder/layer.5/output/LayerNorm/Pow Group 258: Order: 317, OP Type: ReduceMean, Name: /encoder/layer.5/output/LayerNorm/ReduceMean_1 Group 259: Order: 318, OP Type: Add, Name: /encoder/layer.5/output/LayerNorm/Add Group 260: Order: 319, OP Type: Sqrt, Name: /encoder/layer.5/output/LayerNorm/Sqrt Group 261: Order: 320, OP Type: Div, Name: /encoder/layer.5/output/LayerNorm/Div Group 262: Order: 321, OP Type: Mul, Name: /encoder/layer.5/output/LayerNorm/Mul Group 263: Order: 322, OP Type: Add, Name: /encoder/layer.5/output/LayerNorm/Add_1 Group 264: Order: 323, OP Type: MatMul, Name: /encoder/layer.6/attention/self/query/MatMul Order: 324, OP Type: Add, Name: /encoder/layer.6/attention/self/query/Add Group 265: Order: 325, OP Type: MatMul, Name: /encoder/layer.6/attention/self/key/MatMul Order: 326, OP Type: Add, Name: /encoder/layer.6/attention/self/key/Add Group 266: Order: 327, OP Type: Reshape, Name: /encoder/layer.6/attention/self/Reshape Group 267: Order: 328, OP Type: MatMul, Name: /encoder/layer.6/attention/self/value/MatMul Order: 329, OP Type: Add, Name: /encoder/layer.6/attention/self/value/Add Group 268: Order: 330, OP Type: Reshape, Name: /encoder/layer.6/attention/self/Reshape_1 Group 269: Order: 331, OP Type: Transpose, Name: /encoder/layer.6/attention/self/Transpose Group 270: Order: 332, OP Type: Reshape, Name: /encoder/layer.6/attention/self/Reshape_2 Group 271: Order: 333, OP Type: Transpose, Name: /encoder/layer.6/attention/self/Transpose_1 Group 272: Order: 334, OP Type: Transpose, Name: /encoder/layer.6/attention/self/Transpose_2 Group 273: Order: 335, OP Type: MatMul, Name: /encoder/layer.6/attention/self/MatMul Order: 336, OP Type: Div, Name: /encoder/layer.6/attention/self/Div Order: 337, OP Type: Add, Name: /encoder/layer.6/attention/self/Add Group 274: Order: 338, OP Type: Softmax, Name: /encoder/layer.6/attention/self/Softmax Group 275: Order: 339, OP Type: MatMul, Name: /encoder/layer.6/attention/self/MatMul_1 Group 276: Order: 340, OP Type: Transpose, Name: /encoder/layer.6/attention/self/Transpose_3 Group 277: Order: 341, OP Type: Reshape, Name: /encoder/layer.6/attention/self/Reshape_3 Group 278: Order: 342, OP Type: MatMul, Name: /encoder/layer.6/attention/output/dense/MatMul Order: 343, OP Type: Add, Name: /encoder/layer.6/attention/output/dense/Add Order: 344, OP Type: Add, Name: /encoder/layer.6/attention/output/Add Group 279: Order: 345, OP Type: ReduceMean, Name: /encoder/layer.6/attention/output/LayerNorm/ReduceMean Group 280: Order: 346, OP Type: Sub, Name: /encoder/layer.6/attention/output/LayerNorm/Sub Group 281: Order: 347, OP Type: Pow, Name: /encoder/layer.6/attention/output/LayerNorm/Pow Group 282: Order: 348, OP Type: ReduceMean, Name: /encoder/layer.6/attention/output/LayerNorm/ReduceMean_1 Group 283: Order: 349, OP Type: Add, Name: /encoder/layer.6/attention/output/LayerNorm/Add Group 284: Order: 350, OP Type: Sqrt, Name: /encoder/layer.6/attention/output/LayerNorm/Sqrt Group 285: Order: 351, OP Type: Div, Name: /encoder/layer.6/attention/output/LayerNorm/Div Group 286: Order: 352, OP Type: Mul, Name: /encoder/layer.6/attention/output/LayerNorm/Mul Group 287: Order: 353, OP Type: Add, Name: /encoder/layer.6/attention/output/LayerNorm/Add_1 Group 288: Order: 354, OP Type: MatMul, Name: /encoder/layer.6/intermediate/dense/MatMul Order: 355, OP Type: Add, Name: /encoder/layer.6/intermediate/dense/Add Group 289: Order: 356, OP Type: Div, Name: /encoder/layer.6/intermediate/intermediate_act_fn/Div Group 290: Order: 357, OP Type: Erf, Name: /encoder/layer.6/intermediate/intermediate_act_fn/Erf Group 291: Order: 358, OP Type: Add, Name: /encoder/layer.6/intermediate/intermediate_act_fn/Add Group 292: Order: 359, OP Type: Mul, Name: /encoder/layer.6/intermediate/intermediate_act_fn/Mul Group 293: Order: 360, OP Type: Mul, Name: /encoder/layer.6/intermediate/intermediate_act_fn/Mul_1 Group 294: Order: 361, OP Type: MatMul, Name: /encoder/layer.6/output/dense/MatMul Order: 362, OP Type: Add, Name: /encoder/layer.6/output/dense/Add Order: 363, OP Type: Add, Name: /encoder/layer.6/output/Add Group 295: Order: 364, OP Type: ReduceMean, Name: /encoder/layer.6/output/LayerNorm/ReduceMean Group 296: Order: 365, OP Type: Sub, Name: /encoder/layer.6/output/LayerNorm/Sub Group 297: Order: 366, OP Type: Pow, Name: /encoder/layer.6/output/LayerNorm/Pow Group 298: Order: 367, OP Type: ReduceMean, Name: /encoder/layer.6/output/LayerNorm/ReduceMean_1 Group 299: Order: 368, OP Type: Add, Name: /encoder/layer.6/output/LayerNorm/Add Group 300: Order: 369, OP Type: Sqrt, Name: /encoder/layer.6/output/LayerNorm/Sqrt Group 301: Order: 370, OP Type: Div, Name: /encoder/layer.6/output/LayerNorm/Div Group 302: Order: 371, OP Type: Mul, Name: /encoder/layer.6/output/LayerNorm/Mul Group 303: Order: 372, OP Type: Add, Name: /encoder/layer.6/output/LayerNorm/Add_1 Group 304: Order: 373, OP Type: MatMul, Name: /encoder/layer.7/attention/self/query/MatMul Order: 374, OP Type: Add, Name: /encoder/layer.7/attention/self/query/Add Group 305: Order: 375, OP Type: MatMul, Name: /encoder/layer.7/attention/self/key/MatMul Order: 376, OP Type: Add, Name: /encoder/layer.7/attention/self/key/Add Group 306: Order: 377, OP Type: Reshape, Name: /encoder/layer.7/attention/self/Reshape Group 307: Order: 378, OP Type: MatMul, Name: /encoder/layer.7/attention/self/value/MatMul Order: 379, OP Type: Add, Name: /encoder/layer.7/attention/self/value/Add Group 308: Order: 380, OP Type: Reshape, Name: /encoder/layer.7/attention/self/Reshape_1 Group 309: Order: 381, OP Type: Transpose, Name: /encoder/layer.7/attention/self/Transpose Group 310: Order: 382, OP Type: Reshape, Name: /encoder/layer.7/attention/self/Reshape_2 Group 311: Order: 383, OP Type: Transpose, Name: /encoder/layer.7/attention/self/Transpose_1 Group 312: Order: 384, OP Type: Transpose, Name: /encoder/layer.7/attention/self/Transpose_2 Group 313: Order: 385, OP Type: MatMul, Name: /encoder/layer.7/attention/self/MatMul Order: 386, OP Type: Div, Name: /encoder/layer.7/attention/self/Div Order: 387, OP Type: Add, Name: /encoder/layer.7/attention/self/Add Group 314: Order: 388, OP Type: Softmax, Name: /encoder/layer.7/attention/self/Softmax Group 315: Order: 389, OP Type: MatMul, Name: /encoder/layer.7/attention/self/MatMul_1 Group 316: Order: 390, OP Type: Transpose, Name: /encoder/layer.7/attention/self/Transpose_3 Group 317: Order: 391, OP Type: Reshape, Name: /encoder/layer.7/attention/self/Reshape_3 Group 318: Order: 392, OP Type: MatMul, Name: /encoder/layer.7/attention/output/dense/MatMul Order: 393, OP Type: Add, Name: /encoder/layer.7/attention/output/dense/Add Order: 394, OP Type: Add, Name: /encoder/layer.7/attention/output/Add Group 319: Order: 395, OP Type: ReduceMean, Name: /encoder/layer.7/attention/output/LayerNorm/ReduceMean Group 320: Order: 396, OP Type: Sub, Name: /encoder/layer.7/attention/output/LayerNorm/Sub Group 321: Order: 397, OP Type: Pow, Name: /encoder/layer.7/attention/output/LayerNorm/Pow Group 322: Order: 398, OP Type: ReduceMean, Name: /encoder/layer.7/attention/output/LayerNorm/ReduceMean_1 Group 323: Order: 399, OP Type: Add, Name: /encoder/layer.7/attention/output/LayerNorm/Add Group 324: Order: 400, OP Type: Sqrt, Name: /encoder/layer.7/attention/output/LayerNorm/Sqrt Group 325: Order: 401, OP Type: Div, Name: /encoder/layer.7/attention/output/LayerNorm/Div Group 326: Order: 402, OP Type: Mul, Name: /encoder/layer.7/attention/output/LayerNorm/Mul Group 327: Order: 403, OP Type: Add, Name: /encoder/layer.7/attention/output/LayerNorm/Add_1 Group 328: Order: 404, OP Type: MatMul, Name: /encoder/layer.7/intermediate/dense/MatMul Order: 405, OP Type: Add, Name: /encoder/layer.7/intermediate/dense/Add Group 329: Order: 406, OP Type: Div, Name: /encoder/layer.7/intermediate/intermediate_act_fn/Div Group 330: Order: 407, OP Type: Erf, Name: /encoder/layer.7/intermediate/intermediate_act_fn/Erf Group 331: Order: 408, OP Type: Add, Name: /encoder/layer.7/intermediate/intermediate_act_fn/Add Group 332: Order: 409, OP Type: Mul, Name: /encoder/layer.7/intermediate/intermediate_act_fn/Mul Group 333: Order: 410, OP Type: Mul, Name: /encoder/layer.7/intermediate/intermediate_act_fn/Mul_1 Group 334: Order: 411, OP Type: MatMul, Name: /encoder/layer.7/output/dense/MatMul Order: 412, OP Type: Add, Name: /encoder/layer.7/output/dense/Add Order: 413, OP Type: Add, Name: /encoder/layer.7/output/Add Group 335: Order: 414, OP Type: ReduceMean, Name: /encoder/layer.7/output/LayerNorm/ReduceMean Group 336: Order: 415, OP Type: Sub, Name: /encoder/layer.7/output/LayerNorm/Sub Group 337: Order: 416, OP Type: Pow, Name: /encoder/layer.7/output/LayerNorm/Pow Group 338: Order: 417, OP Type: ReduceMean, Name: /encoder/layer.7/output/LayerNorm/ReduceMean_1 Group 339: Order: 418, OP Type: Add, Name: /encoder/layer.7/output/LayerNorm/Add Group 340: Order: 419, OP Type: Sqrt, Name: /encoder/layer.7/output/LayerNorm/Sqrt Group 341: Order: 420, OP Type: Div, Name: /encoder/layer.7/output/LayerNorm/Div Group 342: Order: 421, OP Type: Mul, Name: /encoder/layer.7/output/LayerNorm/Mul Group 343: Order: 422, OP Type: Add, Name: /encoder/layer.7/output/LayerNorm/Add_1 Group 344: Order: 423, OP Type: MatMul, Name: /encoder/layer.8/attention/self/query/MatMul Order: 424, OP Type: Add, Name: /encoder/layer.8/attention/self/query/Add Group 345: Order: 425, OP Type: MatMul, Name: /encoder/layer.8/attention/self/key/MatMul Order: 426, OP Type: Add, Name: /encoder/layer.8/attention/self/key/Add Group 346: Order: 427, OP Type: Reshape, Name: /encoder/layer.8/attention/self/Reshape Group 347: Order: 428, OP Type: MatMul, Name: /encoder/layer.8/attention/self/value/MatMul Order: 429, OP Type: Add, Name: /encoder/layer.8/attention/self/value/Add Group 348: Order: 430, OP Type: Reshape, Name: /encoder/layer.8/attention/self/Reshape_1 Group 349: Order: 431, OP Type: Transpose, Name: /encoder/layer.8/attention/self/Transpose Group 350: Order: 432, OP Type: Reshape, Name: /encoder/layer.8/attention/self/Reshape_2 Group 351: Order: 433, OP Type: Transpose, Name: /encoder/layer.8/attention/self/Transpose_1 Group 352: Order: 434, OP Type: Transpose, Name: /encoder/layer.8/attention/self/Transpose_2 Group 353: Order: 435, OP Type: MatMul, Name: /encoder/layer.8/attention/self/MatMul Order: 436, OP Type: Div, Name: /encoder/layer.8/attention/self/Div Order: 437, OP Type: Add, Name: /encoder/layer.8/attention/self/Add Group 354: Order: 438, OP Type: Softmax, Name: /encoder/layer.8/attention/self/Softmax Group 355: Order: 439, OP Type: MatMul, Name: /encoder/layer.8/attention/self/MatMul_1 Group 356: Order: 440, OP Type: Transpose, Name: /encoder/layer.8/attention/self/Transpose_3 Group 357: Order: 441, OP Type: Reshape, Name: /encoder/layer.8/attention/self/Reshape_3 Group 358: Order: 442, OP Type: MatMul, Name: /encoder/layer.8/attention/output/dense/MatMul Order: 443, OP Type: Add, Name: /encoder/layer.8/attention/output/dense/Add Order: 444, OP Type: Add, Name: /encoder/layer.8/attention/output/Add Group 359: Order: 445, OP Type: ReduceMean, Name: /encoder/layer.8/attention/output/LayerNorm/ReduceMean Group 360: Order: 446, OP Type: Sub, Name: /encoder/layer.8/attention/output/LayerNorm/Sub Group 361: Order: 447, OP Type: Pow, Name: /encoder/layer.8/attention/output/LayerNorm/Pow Group 362: Order: 448, OP Type: ReduceMean, Name: /encoder/layer.8/attention/output/LayerNorm/ReduceMean_1 Group 363: Order: 449, OP Type: Add, Name: /encoder/layer.8/attention/output/LayerNorm/Add Group 364: Order: 450, OP Type: Sqrt, Name: /encoder/layer.8/attention/output/LayerNorm/Sqrt Group 365: Order: 451, OP Type: Div, Name: /encoder/layer.8/attention/output/LayerNorm/Div Group 366: Order: 452, OP Type: Mul, Name: /encoder/layer.8/attention/output/LayerNorm/Mul Group 367: Order: 453, OP Type: Add, Name: /encoder/layer.8/attention/output/LayerNorm/Add_1 Group 368: Order: 454, OP Type: MatMul, Name: /encoder/layer.8/intermediate/dense/MatMul Order: 455, OP Type: Add, Name: /encoder/layer.8/intermediate/dense/Add Group 369: Order: 456, OP Type: Div, Name: /encoder/layer.8/intermediate/intermediate_act_fn/Div Group 370: Order: 457, OP Type: Erf, Name: /encoder/layer.8/intermediate/intermediate_act_fn/Erf Group 371: Order: 458, OP Type: Add, Name: /encoder/layer.8/intermediate/intermediate_act_fn/Add Group 372: Order: 459, OP Type: Mul, Name: /encoder/layer.8/intermediate/intermediate_act_fn/Mul Group 373: Order: 460, OP Type: Mul, Name: /encoder/layer.8/intermediate/intermediate_act_fn/Mul_1 Group 374: Order: 461, OP Type: MatMul, Name: /encoder/layer.8/output/dense/MatMul Order: 462, OP Type: Add, Name: /encoder/layer.8/output/dense/Add Order: 463, OP Type: Add, Name: /encoder/layer.8/output/Add Group 375: Order: 464, OP Type: ReduceMean, Name: /encoder/layer.8/output/LayerNorm/ReduceMean Group 376: Order: 465, OP Type: Sub, Name: /encoder/layer.8/output/LayerNorm/Sub Group 377: Order: 466, OP Type: Pow, Name: /encoder/layer.8/output/LayerNorm/Pow Group 378: Order: 467, OP Type: ReduceMean, Name: /encoder/layer.8/output/LayerNorm/ReduceMean_1 Group 379: Order: 468, OP Type: Add, Name: /encoder/layer.8/output/LayerNorm/Add Group 380: Order: 469, OP Type: Sqrt, Name: /encoder/layer.8/output/LayerNorm/Sqrt Group 381: Order: 470, OP Type: Div, Name: /encoder/layer.8/output/LayerNorm/Div Group 382: Order: 471, OP Type: Mul, Name: /encoder/layer.8/output/LayerNorm/Mul Group 383: Order: 472, OP Type: Add, Name: /encoder/layer.8/output/LayerNorm/Add_1 Group 384: Order: 473, OP Type: MatMul, Name: /encoder/layer.9/attention/self/query/MatMul Order: 474, OP Type: Add, Name: /encoder/layer.9/attention/self/query/Add Group 385: Order: 475, OP Type: MatMul, Name: /encoder/layer.9/attention/self/key/MatMul Order: 476, OP Type: Add, Name: /encoder/layer.9/attention/self/key/Add Group 386: Order: 477, OP Type: Reshape, Name: /encoder/layer.9/attention/self/Reshape Group 387: Order: 478, OP Type: MatMul, Name: /encoder/layer.9/attention/self/value/MatMul Order: 479, OP Type: Add, Name: /encoder/layer.9/attention/self/value/Add Group 388: Order: 480, OP Type: Reshape, Name: /encoder/layer.9/attention/self/Reshape_1 Group 389: Order: 481, OP Type: Transpose, Name: /encoder/layer.9/attention/self/Transpose Group 390: Order: 482, OP Type: Reshape, Name: /encoder/layer.9/attention/self/Reshape_2 Group 391: Order: 483, OP Type: Transpose, Name: /encoder/layer.9/attention/self/Transpose_1 Group 392: Order: 484, OP Type: Transpose, Name: /encoder/layer.9/attention/self/Transpose_2 Group 393: Order: 485, OP Type: MatMul, Name: /encoder/layer.9/attention/self/MatMul Order: 486, OP Type: Div, Name: /encoder/layer.9/attention/self/Div Order: 487, OP Type: Add, Name: /encoder/layer.9/attention/self/Add Group 394: Order: 488, OP Type: Softmax, Name: /encoder/layer.9/attention/self/Softmax Group 395: Order: 489, OP Type: MatMul, Name: /encoder/layer.9/attention/self/MatMul_1 Group 396: Order: 490, OP Type: Transpose, Name: /encoder/layer.9/attention/self/Transpose_3 Group 397: Order: 491, OP Type: Reshape, Name: /encoder/layer.9/attention/self/Reshape_3 Group 398: Order: 492, OP Type: MatMul, Name: /encoder/layer.9/attention/output/dense/MatMul Order: 493, OP Type: Add, Name: /encoder/layer.9/attention/output/dense/Add Order: 494, OP Type: Add, Name: /encoder/layer.9/attention/output/Add Group 399: Order: 495, OP Type: ReduceMean, Name: /encoder/layer.9/attention/output/LayerNorm/ReduceMean Group 400: Order: 496, OP Type: Sub, Name: /encoder/layer.9/attention/output/LayerNorm/Sub Group 401: Order: 497, OP Type: Pow, Name: /encoder/layer.9/attention/output/LayerNorm/Pow Group 402: Order: 498, OP Type: ReduceMean, Name: /encoder/layer.9/attention/output/LayerNorm/ReduceMean_1 Group 403: Order: 499, OP Type: Add, Name: /encoder/layer.9/attention/output/LayerNorm/Add Group 404: Order: 500, OP Type: Sqrt, Name: /encoder/layer.9/attention/output/LayerNorm/Sqrt Group 405: Order: 501, OP Type: Div, Name: /encoder/layer.9/attention/output/LayerNorm/Div Group 406: Order: 502, OP Type: Mul, Name: /encoder/layer.9/attention/output/LayerNorm/Mul Group 407: Order: 503, OP Type: Add, Name: /encoder/layer.9/attention/output/LayerNorm/Add_1 Group 408: Order: 504, OP Type: MatMul, Name: /encoder/layer.9/intermediate/dense/MatMul Order: 505, OP Type: Add, Name: /encoder/layer.9/intermediate/dense/Add Group 409: Order: 506, OP Type: Div, Name: /encoder/layer.9/intermediate/intermediate_act_fn/Div Group 410: Order: 507, OP Type: Erf, Name: /encoder/layer.9/intermediate/intermediate_act_fn/Erf Group 411: Order: 508, OP Type: Add, Name: /encoder/layer.9/intermediate/intermediate_act_fn/Add Group 412: Order: 509, OP Type: Mul, Name: /encoder/layer.9/intermediate/intermediate_act_fn/Mul Group 413: Order: 510, OP Type: Mul, Name: /encoder/layer.9/intermediate/intermediate_act_fn/Mul_1 Group 414: Order: 511, OP Type: MatMul, Name: /encoder/layer.9/output/dense/MatMul Order: 512, OP Type: Add, Name: /encoder/layer.9/output/dense/Add Order: 513, OP Type: Add, Name: /encoder/layer.9/output/Add Group 415: Order: 514, OP Type: ReduceMean, Name: /encoder/layer.9/output/LayerNorm/ReduceMean Group 416: Order: 515, OP Type: Sub, Name: /encoder/layer.9/output/LayerNorm/Sub Group 417: Order: 516, OP Type: Pow, Name: /encoder/layer.9/output/LayerNorm/Pow Group 418: Order: 517, OP Type: ReduceMean, Name: /encoder/layer.9/output/LayerNorm/ReduceMean_1 Group 419: Order: 518, OP Type: Add, Name: /encoder/layer.9/output/LayerNorm/Add Group 420: Order: 519, OP Type: Sqrt, Name: /encoder/layer.9/output/LayerNorm/Sqrt Group 421: Order: 520, OP Type: Div, Name: /encoder/layer.9/output/LayerNorm/Div Group 422: Order: 521, OP Type: Mul, Name: /encoder/layer.9/output/LayerNorm/Mul Group 423: Order: 522, OP Type: Add, Name: /encoder/layer.9/output/LayerNorm/Add_1 Group 424: Order: 523, OP Type: MatMul, Name: /encoder/layer.10/attention/self/query/MatMul Order: 524, OP Type: Add, Name: /encoder/layer.10/attention/self/query/Add Group 425: Order: 525, OP Type: MatMul, Name: /encoder/layer.10/attention/self/key/MatMul Order: 526, OP Type: Add, Name: /encoder/layer.10/attention/self/key/Add Group 426: Order: 527, OP Type: Reshape, Name: /encoder/layer.10/attention/self/Reshape Group 427: Order: 528, OP Type: MatMul, Name: /encoder/layer.10/attention/self/value/MatMul Order: 529, OP Type: Add, Name: /encoder/layer.10/attention/self/value/Add Group 428: Order: 530, OP Type: Reshape, Name: /encoder/layer.10/attention/self/Reshape_1 Group 429: Order: 531, OP Type: Transpose, Name: /encoder/layer.10/attention/self/Transpose Group 430: Order: 532, OP Type: Reshape, Name: /encoder/layer.10/attention/self/Reshape_2 Group 431: Order: 533, OP Type: Transpose, Name: /encoder/layer.10/attention/self/Transpose_1 Group 432: Order: 534, OP Type: Transpose, Name: /encoder/layer.10/attention/self/Transpose_2 Group 433: Order: 535, OP Type: MatMul, Name: /encoder/layer.10/attention/self/MatMul Order: 536, OP Type: Div, Name: /encoder/layer.10/attention/self/Div Order: 537, OP Type: Add, Name: /encoder/layer.10/attention/self/Add Group 434: Order: 538, OP Type: Softmax, Name: /encoder/layer.10/attention/self/Softmax Group 435: Order: 539, OP Type: MatMul, Name: /encoder/layer.10/attention/self/MatMul_1 Group 436: Order: 540, OP Type: Transpose, Name: /encoder/layer.10/attention/self/Transpose_3 Group 437: Order: 541, OP Type: Reshape, Name: /encoder/layer.10/attention/self/Reshape_3 Group 438: Order: 542, OP Type: MatMul, Name: /encoder/layer.10/attention/output/dense/MatMul Order: 543, OP Type: Add, Name: /encoder/layer.10/attention/output/dense/Add Order: 544, OP Type: Add, Name: /encoder/layer.10/attention/output/Add Group 439: Order: 545, OP Type: ReduceMean, Name: /encoder/layer.10/attention/output/LayerNorm/ReduceMean Group 440: Order: 546, OP Type: Sub, Name: /encoder/layer.10/attention/output/LayerNorm/Sub Group 441: Order: 547, OP Type: Pow, Name: /encoder/layer.10/attention/output/LayerNorm/Pow Group 442: Order: 548, OP Type: ReduceMean, Name: /encoder/layer.10/attention/output/LayerNorm/ReduceMean_1 Group 443: Order: 549, OP Type: Add, Name: /encoder/layer.10/attention/output/LayerNorm/Add Group 444: Order: 550, OP Type: Sqrt, Name: /encoder/layer.10/attention/output/LayerNorm/Sqrt Group 445: Order: 551, OP Type: Div, Name: /encoder/layer.10/attention/output/LayerNorm/Div Group 446: Order: 552, OP Type: Mul, Name: /encoder/layer.10/attention/output/LayerNorm/Mul Group 447: Order: 553, OP Type: Add, Name: /encoder/layer.10/attention/output/LayerNorm/Add_1 Group 448: Order: 554, OP Type: MatMul, Name: /encoder/layer.10/intermediate/dense/MatMul Order: 555, OP Type: Add, Name: /encoder/layer.10/intermediate/dense/Add Group 449: Order: 556, OP Type: Div, Name: /encoder/layer.10/intermediate/intermediate_act_fn/Div Group 450: Order: 557, OP Type: Erf, Name: /encoder/layer.10/intermediate/intermediate_act_fn/Erf Group 451: Order: 558, OP Type: Add, Name: /encoder/layer.10/intermediate/intermediate_act_fn/Add Group 452: Order: 559, OP Type: Mul, Name: /encoder/layer.10/intermediate/intermediate_act_fn/Mul Group 453: Order: 560, OP Type: Mul, Name: /encoder/layer.10/intermediate/intermediate_act_fn/Mul_1 Group 454: Order: 561, OP Type: MatMul, Name: /encoder/layer.10/output/dense/MatMul Order: 562, OP Type: Add, Name: /encoder/layer.10/output/dense/Add Order: 563, OP Type: Add, Name: /encoder/layer.10/output/Add Group 455: Order: 564, OP Type: ReduceMean, Name: /encoder/layer.10/output/LayerNorm/ReduceMean Group 456: Order: 565, OP Type: Sub, Name: /encoder/layer.10/output/LayerNorm/Sub Group 457: Order: 566, OP Type: Pow, Name: /encoder/layer.10/output/LayerNorm/Pow Group 458: Order: 567, OP Type: ReduceMean, Name: /encoder/layer.10/output/LayerNorm/ReduceMean_1 Group 459: Order: 568, OP Type: Add, Name: /encoder/layer.10/output/LayerNorm/Add Group 460: Order: 569, OP Type: Sqrt, Name: /encoder/layer.10/output/LayerNorm/Sqrt Group 461: Order: 570, OP Type: Div, Name: /encoder/layer.10/output/LayerNorm/Div Group 462: Order: 571, OP Type: Mul, Name: /encoder/layer.10/output/LayerNorm/Mul Group 463: Order: 572, OP Type: Add, Name: /encoder/layer.10/output/LayerNorm/Add_1 Group 464: Order: 573, OP Type: MatMul, Name: /encoder/layer.11/attention/self/query/MatMul Order: 574, OP Type: Add, Name: /encoder/layer.11/attention/self/query/Add Group 465: Order: 575, OP Type: MatMul, Name: /encoder/layer.11/attention/self/key/MatMul Order: 576, OP Type: Add, Name: /encoder/layer.11/attention/self/key/Add Group 466: Order: 577, OP Type: Reshape, Name: /encoder/layer.11/attention/self/Reshape Group 467: Order: 578, OP Type: MatMul, Name: /encoder/layer.11/attention/self/value/MatMul Order: 579, OP Type: Add, Name: /encoder/layer.11/attention/self/value/Add Group 468: Order: 580, OP Type: Reshape, Name: /encoder/layer.11/attention/self/Reshape_1 Group 469: Order: 581, OP Type: Transpose, Name: /encoder/layer.11/attention/self/Transpose Group 470: Order: 582, OP Type: Reshape, Name: /encoder/layer.11/attention/self/Reshape_2 Group 471: Order: 583, OP Type: Transpose, Name: /encoder/layer.11/attention/self/Transpose_1 Group 472: Order: 584, OP Type: Transpose, Name: /encoder/layer.11/attention/self/Transpose_2 Group 473: Order: 585, OP Type: MatMul, Name: /encoder/layer.11/attention/self/MatMul Order: 586, OP Type: Div, Name: /encoder/layer.11/attention/self/Div Order: 587, OP Type: Add, Name: /encoder/layer.11/attention/self/Add Group 474: Order: 588, OP Type: Softmax, Name: /encoder/layer.11/attention/self/Softmax Group 475: Order: 589, OP Type: MatMul, Name: /encoder/layer.11/attention/self/MatMul_1 Group 476: Order: 590, OP Type: Transpose, Name: /encoder/layer.11/attention/self/Transpose_3 Group 477: Order: 591, OP Type: Reshape, Name: /encoder/layer.11/attention/self/Reshape_3 Group 478: Order: 592, OP Type: MatMul, Name: /encoder/layer.11/attention/output/dense/MatMul Order: 593, OP Type: Add, Name: /encoder/layer.11/attention/output/dense/Add Order: 594, OP Type: Add, Name: /encoder/layer.11/attention/output/Add Group 479: Order: 595, OP Type: ReduceMean, Name: /encoder/layer.11/attention/output/LayerNorm/ReduceMean Group 480: Order: 596, OP Type: Sub, Name: /encoder/layer.11/attention/output/LayerNorm/Sub Group 481: Order: 597, OP Type: Pow, Name: /encoder/layer.11/attention/output/LayerNorm/Pow Group 482: Order: 598, OP Type: ReduceMean, Name: /encoder/layer.11/attention/output/LayerNorm/ReduceMean_1 Group 483: Order: 599, OP Type: Add, Name: /encoder/layer.11/attention/output/LayerNorm/Add Group 484: Order: 600, OP Type: Sqrt, Name: /encoder/layer.11/attention/output/LayerNorm/Sqrt Group 485: Order: 601, OP Type: Div, Name: /encoder/layer.11/attention/output/LayerNorm/Div Group 486: Order: 602, OP Type: Mul, Name: /encoder/layer.11/attention/output/LayerNorm/Mul Group 487: Order: 603, OP Type: Add, Name: /encoder/layer.11/attention/output/LayerNorm/Add_1 Group 488: Order: 604, OP Type: MatMul, Name: /encoder/layer.11/intermediate/dense/MatMul Order: 605, OP Type: Add, Name: /encoder/layer.11/intermediate/dense/Add Group 489: Order: 606, OP Type: Div, Name: /encoder/layer.11/intermediate/intermediate_act_fn/Div Group 490: Order: 607, OP Type: Erf, Name: /encoder/layer.11/intermediate/intermediate_act_fn/Erf Group 491: Order: 608, OP Type: Add, Name: /encoder/layer.11/intermediate/intermediate_act_fn/Add Group 492: Order: 609, OP Type: Mul, Name: /encoder/layer.11/intermediate/intermediate_act_fn/Mul Group 493: Order: 610, OP Type: Mul, Name: /encoder/layer.11/intermediate/intermediate_act_fn/Mul_1 Group 494: Order: 611, OP Type: MatMul, Name: /encoder/layer.11/output/dense/MatMul Order: 612, OP Type: Add, Name: /encoder/layer.11/output/dense/Add Order: 613, OP Type: Add, Name: /encoder/layer.11/output/Add Group 495: Order: 614, OP Type: ReduceMean, Name: /encoder/layer.11/output/LayerNorm/ReduceMean Group 496: Order: 615, OP Type: Sub, Name: /encoder/layer.11/output/LayerNorm/Sub Group 497: Order: 616, OP Type: Pow, Name: /encoder/layer.11/output/LayerNorm/Pow Group 498: Order: 617, OP Type: ReduceMean, Name: /encoder/layer.11/output/LayerNorm/ReduceMean_1 Group 499: Order: 618, OP Type: Add, Name: /encoder/layer.11/output/LayerNorm/Add Group 500: Order: 619, OP Type: Sqrt, Name: /encoder/layer.11/output/LayerNorm/Sqrt Group 501: Order: 620, OP Type: Div, Name: /encoder/layer.11/output/LayerNorm/Div Group 502: Order: 621, OP Type: Mul, Name: /encoder/layer.11/output/LayerNorm/Mul Group 503: Order: 622, OP Type: Add, Name: /encoder/layer.11/output/LayerNorm/Add_1 Group 504: Order: 623, OP Type: Gather, Name: /pooler/Gather Group 505: Order: 624, OP Type: Gemm, Name: /pooler/dense/Gemm Order: 625, OP Type: Tanh, Name: /pooler/activation/Tanh
Leave a Comment