Untitled
user_5573880
c_cpp
5 months ago
56 kB
4
Indexable
Group 1: Order: 0, OP Type: Gather, Name: /token_embedding/Gather Group 2: Order: 1, OP Type: Shape, Name: /Shape Group 3: Order: 2, OP Type: Constant, Name: /Constant Group 4: Order: 3, OP Type: Gather, Name: /Gather Group 5: Order: 4, OP Type: Shape, Name: /Shape_1 Group 6: Order: 5, OP Type: Constant, Name: /Constant_1 Group 7: Order: 6, OP Type: Gather, Name: /Gather_1 Group 8: Order: 7, OP Type: Shape, Name: /Shape_2 Group 9: Order: 8, OP Type: Constant, Name: /Constant_2 Group 10: Order: 9, OP Type: Gather, Name: /Gather_2 Group 11: Order: 10, OP Type: Cast, Name: /Cast Group 12: Order: 11, OP Type: Constant, Name: /Constant_3 Group 13: Order: 12, OP Type: Constant, Name: /Constant_4 Group 14: Order: 13, OP Type: Range, Name: /Range Group 15: Order: 14, OP Type: Gather, Name: /pos_embedding/Gather Group 16: Order: 15, OP Type: Unsqueeze, Name: /Unsqueeze Group 17: Order: 16, OP Type: Unsqueeze, Name: /Unsqueeze_1 Group 18: Order: 17, OP Type: Unsqueeze, Name: /Unsqueeze_2 Group 19: Order: 18, OP Type: Unsqueeze, Name: /Unsqueeze_3 Group 20: Order: 19, OP Type: Concat, Name: /Concat Group 21: Order: 20, OP Type: Constant, Name: /Constant_5 Group 22: Order: 21, OP Type: Reshape, Name: /Reshape Group 23: Order: 22, OP Type: Shape, Name: /Shape_3 Group 24: Order: 23, OP Type: ConstantOfShape, Name: /ConstantOfShape Group 25: Order: 24, OP Type: Constant, Name: /Constant_6 Group 26: Order: 25, OP Type: Mul, Name: /Mul Group 27: Order: 26, OP Type: Equal, Name: /Equal Group 28: Order: 27, OP Type: Where, Name: /Where Group 29: Order: 28, OP Type: Expand, Name: /Expand Group 30: Order: 29, OP Type: Add, Name: /Add Group 31: Order: 30, OP Type: Shape, Name: /tblocks/tblocks.0/attention/Shape Group 32: Order: 31, OP Type: Constant, Name: /tblocks/tblocks.0/attention/Constant Group 33: Order: 32, OP Type: Gather, Name: /tblocks/tblocks.0/attention/Gather Group 34: Order: 33, OP Type: Shape, Name: /tblocks/tblocks.0/attention/Shape_1 Group 35: Order: 34, OP Type: Constant, Name: /tblocks/tblocks.0/attention/Constant_1 Group 36: Order: 35, OP Type: Gather, Name: /tblocks/tblocks.0/attention/Gather_1 Group 37: Order: 36, OP Type: Shape, Name: /tblocks/tblocks.0/attention/Shape_2 Group 38: Order: 37, OP Type: Constant, Name: /tblocks/tblocks.0/attention/Constant_2 Group 39: Order: 38, OP Type: Gather, Name: /tblocks/tblocks.0/attention/Gather_2 Group 40: Order: 39, OP Type: Constant, Name: /tblocks/tblocks.0/attention/Constant_3 Group 41: Order: 40, OP Type: Div, Name: /tblocks/tblocks.0/attention/Div Group 42: Order: 41, OP Type: Cast, Name: /tblocks/tblocks.0/attention/Cast Group 43: Order: 42, OP Type: Cast, Name: /tblocks/tblocks.0/attention/Cast_1 Group 44: Order: 43, OP Type: MatMul, Name: /tblocks/tblocks.0/attention/tokeys/MatMul Group 45: Order: 44, OP Type: MatMul, Name: /tblocks/tblocks.0/attention/toqueries/MatMul Group 46: Order: 45, OP Type: MatMul, Name: /tblocks/tblocks.0/attention/tovalues/MatMul Group 47: Order: 46, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze Group 48: Order: 47, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_1 Group 49: Order: 48, OP Type: Constant, Name: /tblocks/tblocks.0/attention/Constant_4 Group 50: Order: 49, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_2 Group 51: Order: 50, OP Type: Concat, Name: /tblocks/tblocks.0/attention/Concat Group 52: Order: 51, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_3 Group 53: Order: 52, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_4 Group 54: Order: 53, OP Type: Constant, Name: /tblocks/tblocks.0/attention/Constant_5 Group 55: Order: 54, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_5 Group 56: Order: 55, OP Type: Concat, Name: /tblocks/tblocks.0/attention/Concat_1 Group 57: Order: 56, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_6 Group 58: Order: 57, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_7 Group 59: Order: 58, OP Type: Constant, Name: /tblocks/tblocks.0/attention/Constant_6 Group 60: Order: 59, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_8 Group 61: Order: 60, OP Type: Concat, Name: /tblocks/tblocks.0/attention/Concat_2 Group 62: Order: 61, OP Type: Reshape, Name: /tblocks/tblocks.0/attention/Reshape Group 63: Order: 62, OP Type: Reshape, Name: /tblocks/tblocks.0/attention/Reshape_1 Group 64: Order: 63, OP Type: Reshape, Name: /tblocks/tblocks.0/attention/Reshape_2 Group 65: Order: 64, OP Type: Transpose, Name: /tblocks/tblocks.0/attention/Transpose Group 66: Order: 65, OP Type: Constant, Name: /tblocks/tblocks.0/attention/Constant_7 Group 67: Order: 66, OP Type: Mul, Name: /tblocks/tblocks.0/attention/Mul Group 68: Order: 67, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_9 Group 69: Order: 68, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_10 Group 70: Order: 69, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_11 Group 71: Order: 70, OP Type: Concat, Name: /tblocks/tblocks.0/attention/Concat_3 Group 72: Order: 71, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_12 Group 73: Order: 72, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_13 Group 74: Order: 73, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_14 Group 75: Order: 74, OP Type: Concat, Name: /tblocks/tblocks.0/attention/Concat_4 Group 76: Order: 75, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_15 Group 77: Order: 76, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_16 Group 78: Order: 77, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_17 Group 79: Order: 78, OP Type: Concat, Name: /tblocks/tblocks.0/attention/Concat_5 Group 80: Order: 79, OP Type: Reshape, Name: /tblocks/tblocks.0/attention/Reshape_3 Group 81: Order: 80, OP Type: Transpose, Name: /tblocks/tblocks.0/attention/Transpose_1 Group 82: Order: 81, OP Type: Reshape, Name: /tblocks/tblocks.0/attention/Reshape_4 Group 83: Order: 82, OP Type: Transpose, Name: /tblocks/tblocks.0/attention/Transpose_2 Group 84: Order: 83, OP Type: Reshape, Name: /tblocks/tblocks.0/attention/Reshape_5 Group 85: Order: 84, OP Type: Transpose, Name: /tblocks/tblocks.0/attention/Transpose_3 Group 86: Order: 85, OP Type: MatMul, Name: /tblocks/tblocks.0/attention/MatMul Order: 86, OP Type: Constant, Name: /tblocks/tblocks.0/attention/Constant_8 Order: 87, OP Type: Mul, Name: /tblocks/tblocks.0/attention/Mul_1 Order: 88, OP Type: Softmax, Name: /tblocks/tblocks.0/attention/Softmax Group 87: Order: 89, OP Type: MatMul, Name: /tblocks/tblocks.0/attention/MatMul_1 Group 88: Order: 90, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_18 Group 89: Order: 91, OP Type: Constant, Name: /tblocks/tblocks.0/attention/Constant_9 Group 90: Order: 92, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_19 Group 91: Order: 93, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_20 Group 92: Order: 94, OP Type: Concat, Name: /tblocks/tblocks.0/attention/Concat_6 Group 93: Order: 95, OP Type: Reshape, Name: /tblocks/tblocks.0/attention/Reshape_6 Group 94: Order: 96, OP Type: Transpose, Name: /tblocks/tblocks.0/attention/Transpose_4 Group 95: Order: 97, OP Type: Constant, Name: /tblocks/tblocks.0/attention/Constant_10 Group 96: Order: 98, OP Type: Mul, Name: /tblocks/tblocks.0/attention/Mul_2 Group 97: Order: 99, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_21 Group 98: Order: 100, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_22 Group 99: Order: 101, OP Type: Unsqueeze, Name: /tblocks/tblocks.0/attention/Unsqueeze_23 Group 100: Order: 102, OP Type: Concat, Name: /tblocks/tblocks.0/attention/Concat_7 Group 101: Order: 103, OP Type: Reshape, Name: /tblocks/tblocks.0/attention/Reshape_7 Group 102: Order: 104, OP Type: MatMul, Name: /tblocks/tblocks.0/attention/unifyheads/MatMul Order: 105, OP Type: Add, Name: /tblocks/tblocks.0/attention/unifyheads/Add Order: 106, OP Type: Add, Name: /tblocks/tblocks.0/Add Order: 107, OP Type: ReduceMean, Name: /tblocks/tblocks.0/norm1/ReduceMean Order: 108, OP Type: Sub, Name: /tblocks/tblocks.0/norm1/Sub Order: 109, OP Type: Constant, Name: /tblocks/tblocks.0/norm1/Constant Order: 110, OP Type: Pow, Name: /tblocks/tblocks.0/norm1/Pow Order: 111, OP Type: ReduceMean, Name: /tblocks/tblocks.0/norm1/ReduceMean_1 Order: 112, OP Type: Constant, Name: /tblocks/tblocks.0/norm1/Constant_1 Order: 113, OP Type: Add, Name: /tblocks/tblocks.0/norm1/Add Order: 114, OP Type: Sqrt, Name: /tblocks/tblocks.0/norm1/Sqrt Order: 115, OP Type: Div, Name: /tblocks/tblocks.0/norm1/Div Order: 116, OP Type: Mul, Name: /tblocks/tblocks.0/norm1/Mul Order: 117, OP Type: Add, Name: /tblocks/tblocks.0/norm1/Add_1 Group 103: Order: 118, OP Type: MatMul, Name: /tblocks/tblocks.0/ff/ff.0/MatMul Order: 119, OP Type: Add, Name: /tblocks/tblocks.0/ff/ff.0/Add Order: 120, OP Type: Relu, Name: /tblocks/tblocks.0/ff/ff.1/Relu Group 104: Order: 121, OP Type: MatMul, Name: /tblocks/tblocks.0/ff/ff.2/MatMul Order: 122, OP Type: Add, Name: /tblocks/tblocks.0/ff/ff.2/Add Order: 123, OP Type: Add, Name: /tblocks/tblocks.0/Add_1 Order: 124, OP Type: ReduceMean, Name: /tblocks/tblocks.0/norm2/ReduceMean Order: 125, OP Type: Sub, Name: /tblocks/tblocks.0/norm2/Sub Order: 126, OP Type: Constant, Name: /tblocks/tblocks.0/norm2/Constant Order: 127, OP Type: Pow, Name: /tblocks/tblocks.0/norm2/Pow Order: 128, OP Type: ReduceMean, Name: /tblocks/tblocks.0/norm2/ReduceMean_1 Order: 129, OP Type: Constant, Name: /tblocks/tblocks.0/norm2/Constant_1 Order: 130, OP Type: Add, Name: /tblocks/tblocks.0/norm2/Add Order: 131, OP Type: Sqrt, Name: /tblocks/tblocks.0/norm2/Sqrt Order: 132, OP Type: Div, Name: /tblocks/tblocks.0/norm2/Div Order: 133, OP Type: Mul, Name: /tblocks/tblocks.0/norm2/Mul Order: 134, OP Type: Add, Name: /tblocks/tblocks.0/norm2/Add_1 Group 105: Order: 135, OP Type: Shape, Name: /tblocks/tblocks.1/attention/Shape Group 106: Order: 136, OP Type: Constant, Name: /tblocks/tblocks.1/attention/Constant Group 107: Order: 137, OP Type: Gather, Name: /tblocks/tblocks.1/attention/Gather Group 108: Order: 138, OP Type: Shape, Name: /tblocks/tblocks.1/attention/Shape_1 Group 109: Order: 139, OP Type: Constant, Name: /tblocks/tblocks.1/attention/Constant_1 Group 110: Order: 140, OP Type: Gather, Name: /tblocks/tblocks.1/attention/Gather_1 Group 111: Order: 141, OP Type: Shape, Name: /tblocks/tblocks.1/attention/Shape_2 Group 112: Order: 142, OP Type: Constant, Name: /tblocks/tblocks.1/attention/Constant_2 Group 113: Order: 143, OP Type: Gather, Name: /tblocks/tblocks.1/attention/Gather_2 Group 114: Order: 144, OP Type: Constant, Name: /tblocks/tblocks.1/attention/Constant_3 Group 115: Order: 145, OP Type: Div, Name: /tblocks/tblocks.1/attention/Div Group 116: Order: 146, OP Type: Cast, Name: /tblocks/tblocks.1/attention/Cast Group 117: Order: 147, OP Type: Cast, Name: /tblocks/tblocks.1/attention/Cast_1 Group 118: Order: 148, OP Type: MatMul, Name: /tblocks/tblocks.1/attention/tokeys/MatMul Group 119: Order: 149, OP Type: MatMul, Name: /tblocks/tblocks.1/attention/toqueries/MatMul Group 120: Order: 150, OP Type: MatMul, Name: /tblocks/tblocks.1/attention/tovalues/MatMul Group 121: Order: 151, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze Group 122: Order: 152, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_1 Group 123: Order: 153, OP Type: Constant, Name: /tblocks/tblocks.1/attention/Constant_4 Group 124: Order: 154, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_2 Group 125: Order: 155, OP Type: Concat, Name: /tblocks/tblocks.1/attention/Concat Group 126: Order: 156, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_3 Group 127: Order: 157, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_4 Group 128: Order: 158, OP Type: Constant, Name: /tblocks/tblocks.1/attention/Constant_5 Group 129: Order: 159, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_5 Group 130: Order: 160, OP Type: Concat, Name: /tblocks/tblocks.1/attention/Concat_1 Group 131: Order: 161, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_6 Group 132: Order: 162, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_7 Group 133: Order: 163, OP Type: Constant, Name: /tblocks/tblocks.1/attention/Constant_6 Group 134: Order: 164, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_8 Group 135: Order: 165, OP Type: Concat, Name: /tblocks/tblocks.1/attention/Concat_2 Group 136: Order: 166, OP Type: Reshape, Name: /tblocks/tblocks.1/attention/Reshape Group 137: Order: 167, OP Type: Reshape, Name: /tblocks/tblocks.1/attention/Reshape_1 Group 138: Order: 168, OP Type: Reshape, Name: /tblocks/tblocks.1/attention/Reshape_2 Group 139: Order: 169, OP Type: Transpose, Name: /tblocks/tblocks.1/attention/Transpose Group 140: Order: 170, OP Type: Constant, Name: /tblocks/tblocks.1/attention/Constant_7 Group 141: Order: 171, OP Type: Mul, Name: /tblocks/tblocks.1/attention/Mul Group 142: Order: 172, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_9 Group 143: Order: 173, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_10 Group 144: Order: 174, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_11 Group 145: Order: 175, OP Type: Concat, Name: /tblocks/tblocks.1/attention/Concat_3 Group 146: Order: 176, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_12 Group 147: Order: 177, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_13 Group 148: Order: 178, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_14 Group 149: Order: 179, OP Type: Concat, Name: /tblocks/tblocks.1/attention/Concat_4 Group 150: Order: 180, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_15 Group 151: Order: 181, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_16 Group 152: Order: 182, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_17 Group 153: Order: 183, OP Type: Concat, Name: /tblocks/tblocks.1/attention/Concat_5 Group 154: Order: 184, OP Type: Reshape, Name: /tblocks/tblocks.1/attention/Reshape_3 Group 155: Order: 185, OP Type: Transpose, Name: /tblocks/tblocks.1/attention/Transpose_1 Group 156: Order: 186, OP Type: Reshape, Name: /tblocks/tblocks.1/attention/Reshape_4 Group 157: Order: 187, OP Type: Transpose, Name: /tblocks/tblocks.1/attention/Transpose_2 Group 158: Order: 188, OP Type: Reshape, Name: /tblocks/tblocks.1/attention/Reshape_5 Group 159: Order: 189, OP Type: Transpose, Name: /tblocks/tblocks.1/attention/Transpose_3 Group 160: Order: 190, OP Type: MatMul, Name: /tblocks/tblocks.1/attention/MatMul Order: 191, OP Type: Constant, Name: /tblocks/tblocks.1/attention/Constant_8 Order: 192, OP Type: Mul, Name: /tblocks/tblocks.1/attention/Mul_1 Order: 193, OP Type: Softmax, Name: /tblocks/tblocks.1/attention/Softmax Group 161: Order: 194, OP Type: MatMul, Name: /tblocks/tblocks.1/attention/MatMul_1 Group 162: Order: 195, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_18 Group 163: Order: 196, OP Type: Constant, Name: /tblocks/tblocks.1/attention/Constant_9 Group 164: Order: 197, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_19 Group 165: Order: 198, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_20 Group 166: Order: 199, OP Type: Concat, Name: /tblocks/tblocks.1/attention/Concat_6 Group 167: Order: 200, OP Type: Reshape, Name: /tblocks/tblocks.1/attention/Reshape_6 Group 168: Order: 201, OP Type: Transpose, Name: /tblocks/tblocks.1/attention/Transpose_4 Group 169: Order: 202, OP Type: Constant, Name: /tblocks/tblocks.1/attention/Constant_10 Group 170: Order: 203, OP Type: Mul, Name: /tblocks/tblocks.1/attention/Mul_2 Group 171: Order: 204, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_21 Group 172: Order: 205, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_22 Group 173: Order: 206, OP Type: Unsqueeze, Name: /tblocks/tblocks.1/attention/Unsqueeze_23 Group 174: Order: 207, OP Type: Concat, Name: /tblocks/tblocks.1/attention/Concat_7 Group 175: Order: 208, OP Type: Reshape, Name: /tblocks/tblocks.1/attention/Reshape_7 Group 176: Order: 209, OP Type: MatMul, Name: /tblocks/tblocks.1/attention/unifyheads/MatMul Order: 210, OP Type: Add, Name: /tblocks/tblocks.1/attention/unifyheads/Add Order: 211, OP Type: Add, Name: /tblocks/tblocks.1/Add Order: 212, OP Type: ReduceMean, Name: /tblocks/tblocks.1/norm1/ReduceMean Order: 213, OP Type: Sub, Name: /tblocks/tblocks.1/norm1/Sub Order: 214, OP Type: Constant, Name: /tblocks/tblocks.1/norm1/Constant Order: 215, OP Type: Pow, Name: /tblocks/tblocks.1/norm1/Pow Order: 216, OP Type: ReduceMean, Name: /tblocks/tblocks.1/norm1/ReduceMean_1 Order: 217, OP Type: Constant, Name: /tblocks/tblocks.1/norm1/Constant_1 Order: 218, OP Type: Add, Name: /tblocks/tblocks.1/norm1/Add Order: 219, OP Type: Sqrt, Name: /tblocks/tblocks.1/norm1/Sqrt Order: 220, OP Type: Div, Name: /tblocks/tblocks.1/norm1/Div Order: 221, OP Type: Mul, Name: /tblocks/tblocks.1/norm1/Mul Order: 222, OP Type: Add, Name: /tblocks/tblocks.1/norm1/Add_1 Group 177: Order: 223, OP Type: MatMul, Name: /tblocks/tblocks.1/ff/ff.0/MatMul Order: 224, OP Type: Add, Name: /tblocks/tblocks.1/ff/ff.0/Add Order: 225, OP Type: Relu, Name: /tblocks/tblocks.1/ff/ff.1/Relu Group 178: Order: 226, OP Type: MatMul, Name: /tblocks/tblocks.1/ff/ff.2/MatMul Order: 227, OP Type: Add, Name: /tblocks/tblocks.1/ff/ff.2/Add Order: 228, OP Type: Add, Name: /tblocks/tblocks.1/Add_1 Order: 229, OP Type: ReduceMean, Name: /tblocks/tblocks.1/norm2/ReduceMean Order: 230, OP Type: Sub, Name: /tblocks/tblocks.1/norm2/Sub Order: 231, OP Type: Constant, Name: /tblocks/tblocks.1/norm2/Constant Order: 232, OP Type: Pow, Name: /tblocks/tblocks.1/norm2/Pow Order: 233, OP Type: ReduceMean, Name: /tblocks/tblocks.1/norm2/ReduceMean_1 Order: 234, OP Type: Constant, Name: /tblocks/tblocks.1/norm2/Constant_1 Order: 235, OP Type: Add, Name: /tblocks/tblocks.1/norm2/Add Order: 236, OP Type: Sqrt, Name: /tblocks/tblocks.1/norm2/Sqrt Order: 237, OP Type: Div, Name: /tblocks/tblocks.1/norm2/Div Order: 238, OP Type: Mul, Name: /tblocks/tblocks.1/norm2/Mul Order: 239, OP Type: Add, Name: /tblocks/tblocks.1/norm2/Add_1 Group 179: Order: 240, OP Type: Shape, Name: /tblocks/tblocks.2/attention/Shape Group 180: Order: 241, OP Type: Constant, Name: /tblocks/tblocks.2/attention/Constant Group 181: Order: 242, OP Type: Gather, Name: /tblocks/tblocks.2/attention/Gather Group 182: Order: 243, OP Type: Shape, Name: /tblocks/tblocks.2/attention/Shape_1 Group 183: Order: 244, OP Type: Constant, Name: /tblocks/tblocks.2/attention/Constant_1 Group 184: Order: 245, OP Type: Gather, Name: /tblocks/tblocks.2/attention/Gather_1 Group 185: Order: 246, OP Type: Shape, Name: /tblocks/tblocks.2/attention/Shape_2 Group 186: Order: 247, OP Type: Constant, Name: /tblocks/tblocks.2/attention/Constant_2 Group 187: Order: 248, OP Type: Gather, Name: /tblocks/tblocks.2/attention/Gather_2 Group 188: Order: 249, OP Type: Constant, Name: /tblocks/tblocks.2/attention/Constant_3 Group 189: Order: 250, OP Type: Div, Name: /tblocks/tblocks.2/attention/Div Group 190: Order: 251, OP Type: Cast, Name: /tblocks/tblocks.2/attention/Cast Group 191: Order: 252, OP Type: Cast, Name: /tblocks/tblocks.2/attention/Cast_1 Group 192: Order: 253, OP Type: MatMul, Name: /tblocks/tblocks.2/attention/tokeys/MatMul Group 193: Order: 254, OP Type: MatMul, Name: /tblocks/tblocks.2/attention/toqueries/MatMul Group 194: Order: 255, OP Type: MatMul, Name: /tblocks/tblocks.2/attention/tovalues/MatMul Group 195: Order: 256, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze Group 196: Order: 257, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_1 Group 197: Order: 258, OP Type: Constant, Name: /tblocks/tblocks.2/attention/Constant_4 Group 198: Order: 259, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_2 Group 199: Order: 260, OP Type: Concat, Name: /tblocks/tblocks.2/attention/Concat Group 200: Order: 261, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_3 Group 201: Order: 262, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_4 Group 202: Order: 263, OP Type: Constant, Name: /tblocks/tblocks.2/attention/Constant_5 Group 203: Order: 264, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_5 Group 204: Order: 265, OP Type: Concat, Name: /tblocks/tblocks.2/attention/Concat_1 Group 205: Order: 266, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_6 Group 206: Order: 267, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_7 Group 207: Order: 268, OP Type: Constant, Name: /tblocks/tblocks.2/attention/Constant_6 Group 208: Order: 269, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_8 Group 209: Order: 270, OP Type: Concat, Name: /tblocks/tblocks.2/attention/Concat_2 Group 210: Order: 271, OP Type: Reshape, Name: /tblocks/tblocks.2/attention/Reshape Group 211: Order: 272, OP Type: Reshape, Name: /tblocks/tblocks.2/attention/Reshape_1 Group 212: Order: 273, OP Type: Reshape, Name: /tblocks/tblocks.2/attention/Reshape_2 Group 213: Order: 274, OP Type: Transpose, Name: /tblocks/tblocks.2/attention/Transpose Group 214: Order: 275, OP Type: Constant, Name: /tblocks/tblocks.2/attention/Constant_7 Group 215: Order: 276, OP Type: Mul, Name: /tblocks/tblocks.2/attention/Mul Group 216: Order: 277, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_9 Group 217: Order: 278, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_10 Group 218: Order: 279, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_11 Group 219: Order: 280, OP Type: Concat, Name: /tblocks/tblocks.2/attention/Concat_3 Group 220: Order: 281, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_12 Group 221: Order: 282, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_13 Group 222: Order: 283, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_14 Group 223: Order: 284, OP Type: Concat, Name: /tblocks/tblocks.2/attention/Concat_4 Group 224: Order: 285, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_15 Group 225: Order: 286, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_16 Group 226: Order: 287, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_17 Group 227: Order: 288, OP Type: Concat, Name: /tblocks/tblocks.2/attention/Concat_5 Group 228: Order: 289, OP Type: Reshape, Name: /tblocks/tblocks.2/attention/Reshape_3 Group 229: Order: 290, OP Type: Transpose, Name: /tblocks/tblocks.2/attention/Transpose_1 Group 230: Order: 291, OP Type: Reshape, Name: /tblocks/tblocks.2/attention/Reshape_4 Group 231: Order: 292, OP Type: Transpose, Name: /tblocks/tblocks.2/attention/Transpose_2 Group 232: Order: 293, OP Type: Reshape, Name: /tblocks/tblocks.2/attention/Reshape_5 Group 233: Order: 294, OP Type: Transpose, Name: /tblocks/tblocks.2/attention/Transpose_3 Group 234: Order: 295, OP Type: MatMul, Name: /tblocks/tblocks.2/attention/MatMul Order: 296, OP Type: Constant, Name: /tblocks/tblocks.2/attention/Constant_8 Order: 297, OP Type: Mul, Name: /tblocks/tblocks.2/attention/Mul_1 Order: 298, OP Type: Softmax, Name: /tblocks/tblocks.2/attention/Softmax Group 235: Order: 299, OP Type: MatMul, Name: /tblocks/tblocks.2/attention/MatMul_1 Group 236: Order: 300, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_18 Group 237: Order: 301, OP Type: Constant, Name: /tblocks/tblocks.2/attention/Constant_9 Group 238: Order: 302, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_19 Group 239: Order: 303, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_20 Group 240: Order: 304, OP Type: Concat, Name: /tblocks/tblocks.2/attention/Concat_6 Group 241: Order: 305, OP Type: Reshape, Name: /tblocks/tblocks.2/attention/Reshape_6 Group 242: Order: 306, OP Type: Transpose, Name: /tblocks/tblocks.2/attention/Transpose_4 Group 243: Order: 307, OP Type: Constant, Name: /tblocks/tblocks.2/attention/Constant_10 Group 244: Order: 308, OP Type: Mul, Name: /tblocks/tblocks.2/attention/Mul_2 Group 245: Order: 309, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_21 Group 246: Order: 310, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_22 Group 247: Order: 311, OP Type: Unsqueeze, Name: /tblocks/tblocks.2/attention/Unsqueeze_23 Group 248: Order: 312, OP Type: Concat, Name: /tblocks/tblocks.2/attention/Concat_7 Group 249: Order: 313, OP Type: Reshape, Name: /tblocks/tblocks.2/attention/Reshape_7 Group 250: Order: 314, OP Type: MatMul, Name: /tblocks/tblocks.2/attention/unifyheads/MatMul Order: 315, OP Type: Add, Name: /tblocks/tblocks.2/attention/unifyheads/Add Order: 316, OP Type: Add, Name: /tblocks/tblocks.2/Add Order: 317, OP Type: ReduceMean, Name: /tblocks/tblocks.2/norm1/ReduceMean Order: 318, OP Type: Sub, Name: /tblocks/tblocks.2/norm1/Sub Order: 319, OP Type: Constant, Name: /tblocks/tblocks.2/norm1/Constant Order: 320, OP Type: Pow, Name: /tblocks/tblocks.2/norm1/Pow Order: 321, OP Type: ReduceMean, Name: /tblocks/tblocks.2/norm1/ReduceMean_1 Order: 322, OP Type: Constant, Name: /tblocks/tblocks.2/norm1/Constant_1 Order: 323, OP Type: Add, Name: /tblocks/tblocks.2/norm1/Add Order: 324, OP Type: Sqrt, Name: /tblocks/tblocks.2/norm1/Sqrt Order: 325, OP Type: Div, Name: /tblocks/tblocks.2/norm1/Div Order: 326, OP Type: Mul, Name: /tblocks/tblocks.2/norm1/Mul Order: 327, OP Type: Add, Name: /tblocks/tblocks.2/norm1/Add_1 Group 251: Order: 328, OP Type: MatMul, Name: /tblocks/tblocks.2/ff/ff.0/MatMul Order: 329, OP Type: Add, Name: /tblocks/tblocks.2/ff/ff.0/Add Order: 330, OP Type: Relu, Name: /tblocks/tblocks.2/ff/ff.1/Relu Group 252: Order: 331, OP Type: MatMul, Name: /tblocks/tblocks.2/ff/ff.2/MatMul Order: 332, OP Type: Add, Name: /tblocks/tblocks.2/ff/ff.2/Add Order: 333, OP Type: Add, Name: /tblocks/tblocks.2/Add_1 Order: 334, OP Type: ReduceMean, Name: /tblocks/tblocks.2/norm2/ReduceMean Order: 335, OP Type: Sub, Name: /tblocks/tblocks.2/norm2/Sub Order: 336, OP Type: Constant, Name: /tblocks/tblocks.2/norm2/Constant Order: 337, OP Type: Pow, Name: /tblocks/tblocks.2/norm2/Pow Order: 338, OP Type: ReduceMean, Name: /tblocks/tblocks.2/norm2/ReduceMean_1 Order: 339, OP Type: Constant, Name: /tblocks/tblocks.2/norm2/Constant_1 Order: 340, OP Type: Add, Name: /tblocks/tblocks.2/norm2/Add Order: 341, OP Type: Sqrt, Name: /tblocks/tblocks.2/norm2/Sqrt Order: 342, OP Type: Div, Name: /tblocks/tblocks.2/norm2/Div Order: 343, OP Type: Mul, Name: /tblocks/tblocks.2/norm2/Mul Order: 344, OP Type: Add, Name: /tblocks/tblocks.2/norm2/Add_1 Group 253: Order: 345, OP Type: Shape, Name: /tblocks/tblocks.3/attention/Shape Group 254: Order: 346, OP Type: Constant, Name: /tblocks/tblocks.3/attention/Constant Group 255: Order: 347, OP Type: Gather, Name: /tblocks/tblocks.3/attention/Gather Group 256: Order: 348, OP Type: Shape, Name: /tblocks/tblocks.3/attention/Shape_1 Group 257: Order: 349, OP Type: Constant, Name: /tblocks/tblocks.3/attention/Constant_1 Group 258: Order: 350, OP Type: Gather, Name: /tblocks/tblocks.3/attention/Gather_1 Group 259: Order: 351, OP Type: Shape, Name: /tblocks/tblocks.3/attention/Shape_2 Group 260: Order: 352, OP Type: Constant, Name: /tblocks/tblocks.3/attention/Constant_2 Group 261: Order: 353, OP Type: Gather, Name: /tblocks/tblocks.3/attention/Gather_2 Group 262: Order: 354, OP Type: Constant, Name: /tblocks/tblocks.3/attention/Constant_3 Group 263: Order: 355, OP Type: Div, Name: /tblocks/tblocks.3/attention/Div Group 264: Order: 356, OP Type: Cast, Name: /tblocks/tblocks.3/attention/Cast Group 265: Order: 357, OP Type: Cast, Name: /tblocks/tblocks.3/attention/Cast_1 Group 266: Order: 358, OP Type: MatMul, Name: /tblocks/tblocks.3/attention/tokeys/MatMul Group 267: Order: 359, OP Type: MatMul, Name: /tblocks/tblocks.3/attention/toqueries/MatMul Group 268: Order: 360, OP Type: MatMul, Name: /tblocks/tblocks.3/attention/tovalues/MatMul Group 269: Order: 361, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze Group 270: Order: 362, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_1 Group 271: Order: 363, OP Type: Constant, Name: /tblocks/tblocks.3/attention/Constant_4 Group 272: Order: 364, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_2 Group 273: Order: 365, OP Type: Concat, Name: /tblocks/tblocks.3/attention/Concat Group 274: Order: 366, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_3 Group 275: Order: 367, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_4 Group 276: Order: 368, OP Type: Constant, Name: /tblocks/tblocks.3/attention/Constant_5 Group 277: Order: 369, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_5 Group 278: Order: 370, OP Type: Concat, Name: /tblocks/tblocks.3/attention/Concat_1 Group 279: Order: 371, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_6 Group 280: Order: 372, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_7 Group 281: Order: 373, OP Type: Constant, Name: /tblocks/tblocks.3/attention/Constant_6 Group 282: Order: 374, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_8 Group 283: Order: 375, OP Type: Concat, Name: /tblocks/tblocks.3/attention/Concat_2 Group 284: Order: 376, OP Type: Reshape, Name: /tblocks/tblocks.3/attention/Reshape Group 285: Order: 377, OP Type: Reshape, Name: /tblocks/tblocks.3/attention/Reshape_1 Group 286: Order: 378, OP Type: Reshape, Name: /tblocks/tblocks.3/attention/Reshape_2 Group 287: Order: 379, OP Type: Transpose, Name: /tblocks/tblocks.3/attention/Transpose Group 288: Order: 380, OP Type: Constant, Name: /tblocks/tblocks.3/attention/Constant_7 Group 289: Order: 381, OP Type: Mul, Name: /tblocks/tblocks.3/attention/Mul Group 290: Order: 382, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_9 Group 291: Order: 383, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_10 Group 292: Order: 384, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_11 Group 293: Order: 385, OP Type: Concat, Name: /tblocks/tblocks.3/attention/Concat_3 Group 294: Order: 386, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_12 Group 295: Order: 387, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_13 Group 296: Order: 388, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_14 Group 297: Order: 389, OP Type: Concat, Name: /tblocks/tblocks.3/attention/Concat_4 Group 298: Order: 390, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_15 Group 299: Order: 391, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_16 Group 300: Order: 392, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_17 Group 301: Order: 393, OP Type: Concat, Name: /tblocks/tblocks.3/attention/Concat_5 Group 302: Order: 394, OP Type: Reshape, Name: /tblocks/tblocks.3/attention/Reshape_3 Group 303: Order: 395, OP Type: Transpose, Name: /tblocks/tblocks.3/attention/Transpose_1 Group 304: Order: 396, OP Type: Reshape, Name: /tblocks/tblocks.3/attention/Reshape_4 Group 305: Order: 397, OP Type: Transpose, Name: /tblocks/tblocks.3/attention/Transpose_2 Group 306: Order: 398, OP Type: Reshape, Name: /tblocks/tblocks.3/attention/Reshape_5 Group 307: Order: 399, OP Type: Transpose, Name: /tblocks/tblocks.3/attention/Transpose_3 Group 308: Order: 400, OP Type: MatMul, Name: /tblocks/tblocks.3/attention/MatMul Order: 401, OP Type: Constant, Name: /tblocks/tblocks.3/attention/Constant_8 Order: 402, OP Type: Mul, Name: /tblocks/tblocks.3/attention/Mul_1 Order: 403, OP Type: Softmax, Name: /tblocks/tblocks.3/attention/Softmax Group 309: Order: 404, OP Type: MatMul, Name: /tblocks/tblocks.3/attention/MatMul_1 Group 310: Order: 405, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_18 Group 311: Order: 406, OP Type: Constant, Name: /tblocks/tblocks.3/attention/Constant_9 Group 312: Order: 407, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_19 Group 313: Order: 408, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_20 Group 314: Order: 409, OP Type: Concat, Name: /tblocks/tblocks.3/attention/Concat_6 Group 315: Order: 410, OP Type: Reshape, Name: /tblocks/tblocks.3/attention/Reshape_6 Group 316: Order: 411, OP Type: Transpose, Name: /tblocks/tblocks.3/attention/Transpose_4 Group 317: Order: 412, OP Type: Constant, Name: /tblocks/tblocks.3/attention/Constant_10 Group 318: Order: 413, OP Type: Mul, Name: /tblocks/tblocks.3/attention/Mul_2 Group 319: Order: 414, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_21 Group 320: Order: 415, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_22 Group 321: Order: 416, OP Type: Unsqueeze, Name: /tblocks/tblocks.3/attention/Unsqueeze_23 Group 322: Order: 417, OP Type: Concat, Name: /tblocks/tblocks.3/attention/Concat_7 Group 323: Order: 418, OP Type: Reshape, Name: /tblocks/tblocks.3/attention/Reshape_7 Group 324: Order: 419, OP Type: MatMul, Name: /tblocks/tblocks.3/attention/unifyheads/MatMul Order: 420, OP Type: Add, Name: /tblocks/tblocks.3/attention/unifyheads/Add Order: 421, OP Type: Add, Name: /tblocks/tblocks.3/Add Order: 422, OP Type: ReduceMean, Name: /tblocks/tblocks.3/norm1/ReduceMean Order: 423, OP Type: Sub, Name: /tblocks/tblocks.3/norm1/Sub Order: 424, OP Type: Constant, Name: /tblocks/tblocks.3/norm1/Constant Order: 425, OP Type: Pow, Name: /tblocks/tblocks.3/norm1/Pow Order: 426, OP Type: ReduceMean, Name: /tblocks/tblocks.3/norm1/ReduceMean_1 Order: 427, OP Type: Constant, Name: /tblocks/tblocks.3/norm1/Constant_1 Order: 428, OP Type: Add, Name: /tblocks/tblocks.3/norm1/Add Order: 429, OP Type: Sqrt, Name: /tblocks/tblocks.3/norm1/Sqrt Order: 430, OP Type: Div, Name: /tblocks/tblocks.3/norm1/Div Order: 431, OP Type: Mul, Name: /tblocks/tblocks.3/norm1/Mul Order: 432, OP Type: Add, Name: /tblocks/tblocks.3/norm1/Add_1 Group 325: Order: 433, OP Type: MatMul, Name: /tblocks/tblocks.3/ff/ff.0/MatMul Order: 434, OP Type: Add, Name: /tblocks/tblocks.3/ff/ff.0/Add Order: 435, OP Type: Relu, Name: /tblocks/tblocks.3/ff/ff.1/Relu Group 326: Order: 436, OP Type: MatMul, Name: /tblocks/tblocks.3/ff/ff.2/MatMul Order: 437, OP Type: Add, Name: /tblocks/tblocks.3/ff/ff.2/Add Order: 438, OP Type: Add, Name: /tblocks/tblocks.3/Add_1 Order: 439, OP Type: ReduceMean, Name: /tblocks/tblocks.3/norm2/ReduceMean Order: 440, OP Type: Sub, Name: /tblocks/tblocks.3/norm2/Sub Order: 441, OP Type: Constant, Name: /tblocks/tblocks.3/norm2/Constant Order: 442, OP Type: Pow, Name: /tblocks/tblocks.3/norm2/Pow Order: 443, OP Type: ReduceMean, Name: /tblocks/tblocks.3/norm2/ReduceMean_1 Order: 444, OP Type: Constant, Name: /tblocks/tblocks.3/norm2/Constant_1 Order: 445, OP Type: Add, Name: /tblocks/tblocks.3/norm2/Add Order: 446, OP Type: Sqrt, Name: /tblocks/tblocks.3/norm2/Sqrt Order: 447, OP Type: Div, Name: /tblocks/tblocks.3/norm2/Div Order: 448, OP Type: Mul, Name: /tblocks/tblocks.3/norm2/Mul Order: 449, OP Type: Add, Name: /tblocks/tblocks.3/norm2/Add_1 Group 327: Order: 450, OP Type: Shape, Name: /tblocks/tblocks.4/attention/Shape Group 328: Order: 451, OP Type: Constant, Name: /tblocks/tblocks.4/attention/Constant Group 329: Order: 452, OP Type: Gather, Name: /tblocks/tblocks.4/attention/Gather Group 330: Order: 453, OP Type: Shape, Name: /tblocks/tblocks.4/attention/Shape_1 Group 331: Order: 454, OP Type: Constant, Name: /tblocks/tblocks.4/attention/Constant_1 Group 332: Order: 455, OP Type: Gather, Name: /tblocks/tblocks.4/attention/Gather_1 Group 333: Order: 456, OP Type: Shape, Name: /tblocks/tblocks.4/attention/Shape_2 Group 334: Order: 457, OP Type: Constant, Name: /tblocks/tblocks.4/attention/Constant_2 Group 335: Order: 458, OP Type: Gather, Name: /tblocks/tblocks.4/attention/Gather_2 Group 336: Order: 459, OP Type: Constant, Name: /tblocks/tblocks.4/attention/Constant_3 Group 337: Order: 460, OP Type: Div, Name: /tblocks/tblocks.4/attention/Div Group 338: Order: 461, OP Type: Cast, Name: /tblocks/tblocks.4/attention/Cast Group 339: Order: 462, OP Type: Cast, Name: /tblocks/tblocks.4/attention/Cast_1 Group 340: Order: 463, OP Type: MatMul, Name: /tblocks/tblocks.4/attention/tokeys/MatMul Group 341: Order: 464, OP Type: MatMul, Name: /tblocks/tblocks.4/attention/toqueries/MatMul Group 342: Order: 465, OP Type: MatMul, Name: /tblocks/tblocks.4/attention/tovalues/MatMul Group 343: Order: 466, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze Group 344: Order: 467, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_1 Group 345: Order: 468, OP Type: Constant, Name: /tblocks/tblocks.4/attention/Constant_4 Group 346: Order: 469, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_2 Group 347: Order: 470, OP Type: Concat, Name: /tblocks/tblocks.4/attention/Concat Group 348: Order: 471, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_3 Group 349: Order: 472, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_4 Group 350: Order: 473, OP Type: Constant, Name: /tblocks/tblocks.4/attention/Constant_5 Group 351: Order: 474, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_5 Group 352: Order: 475, OP Type: Concat, Name: /tblocks/tblocks.4/attention/Concat_1 Group 353: Order: 476, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_6 Group 354: Order: 477, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_7 Group 355: Order: 478, OP Type: Constant, Name: /tblocks/tblocks.4/attention/Constant_6 Group 356: Order: 479, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_8 Group 357: Order: 480, OP Type: Concat, Name: /tblocks/tblocks.4/attention/Concat_2 Group 358: Order: 481, OP Type: Reshape, Name: /tblocks/tblocks.4/attention/Reshape Group 359: Order: 482, OP Type: Reshape, Name: /tblocks/tblocks.4/attention/Reshape_1 Group 360: Order: 483, OP Type: Reshape, Name: /tblocks/tblocks.4/attention/Reshape_2 Group 361: Order: 484, OP Type: Transpose, Name: /tblocks/tblocks.4/attention/Transpose Group 362: Order: 485, OP Type: Constant, Name: /tblocks/tblocks.4/attention/Constant_7 Group 363: Order: 486, OP Type: Mul, Name: /tblocks/tblocks.4/attention/Mul Group 364: Order: 487, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_9 Group 365: Order: 488, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_10 Group 366: Order: 489, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_11 Group 367: Order: 490, OP Type: Concat, Name: /tblocks/tblocks.4/attention/Concat_3 Group 368: Order: 491, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_12 Group 369: Order: 492, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_13 Group 370: Order: 493, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_14 Group 371: Order: 494, OP Type: Concat, Name: /tblocks/tblocks.4/attention/Concat_4 Group 372: Order: 495, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_15 Group 373: Order: 496, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_16 Group 374: Order: 497, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_17 Group 375: Order: 498, OP Type: Concat, Name: /tblocks/tblocks.4/attention/Concat_5 Group 376: Order: 499, OP Type: Reshape, Name: /tblocks/tblocks.4/attention/Reshape_3 Group 377: Order: 500, OP Type: Transpose, Name: /tblocks/tblocks.4/attention/Transpose_1 Group 378: Order: 501, OP Type: Reshape, Name: /tblocks/tblocks.4/attention/Reshape_4 Group 379: Order: 502, OP Type: Transpose, Name: /tblocks/tblocks.4/attention/Transpose_2 Group 380: Order: 503, OP Type: Reshape, Name: /tblocks/tblocks.4/attention/Reshape_5 Group 381: Order: 504, OP Type: Transpose, Name: /tblocks/tblocks.4/attention/Transpose_3 Group 382: Order: 505, OP Type: MatMul, Name: /tblocks/tblocks.4/attention/MatMul Order: 506, OP Type: Constant, Name: /tblocks/tblocks.4/attention/Constant_8 Order: 507, OP Type: Mul, Name: /tblocks/tblocks.4/attention/Mul_1 Order: 508, OP Type: Softmax, Name: /tblocks/tblocks.4/attention/Softmax Group 383: Order: 509, OP Type: MatMul, Name: /tblocks/tblocks.4/attention/MatMul_1 Group 384: Order: 510, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_18 Group 385: Order: 511, OP Type: Constant, Name: /tblocks/tblocks.4/attention/Constant_9 Group 386: Order: 512, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_19 Group 387: Order: 513, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_20 Group 388: Order: 514, OP Type: Concat, Name: /tblocks/tblocks.4/attention/Concat_6 Group 389: Order: 515, OP Type: Reshape, Name: /tblocks/tblocks.4/attention/Reshape_6 Group 390: Order: 516, OP Type: Transpose, Name: /tblocks/tblocks.4/attention/Transpose_4 Group 391: Order: 517, OP Type: Constant, Name: /tblocks/tblocks.4/attention/Constant_10 Group 392: Order: 518, OP Type: Mul, Name: /tblocks/tblocks.4/attention/Mul_2 Group 393: Order: 519, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_21 Group 394: Order: 520, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_22 Group 395: Order: 521, OP Type: Unsqueeze, Name: /tblocks/tblocks.4/attention/Unsqueeze_23 Group 396: Order: 522, OP Type: Concat, Name: /tblocks/tblocks.4/attention/Concat_7 Group 397: Order: 523, OP Type: Reshape, Name: /tblocks/tblocks.4/attention/Reshape_7 Group 398: Order: 524, OP Type: MatMul, Name: /tblocks/tblocks.4/attention/unifyheads/MatMul Order: 525, OP Type: Add, Name: /tblocks/tblocks.4/attention/unifyheads/Add Order: 526, OP Type: Add, Name: /tblocks/tblocks.4/Add Order: 527, OP Type: ReduceMean, Name: /tblocks/tblocks.4/norm1/ReduceMean Order: 528, OP Type: Sub, Name: /tblocks/tblocks.4/norm1/Sub Order: 529, OP Type: Constant, Name: /tblocks/tblocks.4/norm1/Constant Order: 530, OP Type: Pow, Name: /tblocks/tblocks.4/norm1/Pow Order: 531, OP Type: ReduceMean, Name: /tblocks/tblocks.4/norm1/ReduceMean_1 Order: 532, OP Type: Constant, Name: /tblocks/tblocks.4/norm1/Constant_1 Order: 533, OP Type: Add, Name: /tblocks/tblocks.4/norm1/Add Order: 534, OP Type: Sqrt, Name: /tblocks/tblocks.4/norm1/Sqrt Order: 535, OP Type: Div, Name: /tblocks/tblocks.4/norm1/Div Order: 536, OP Type: Mul, Name: /tblocks/tblocks.4/norm1/Mul Order: 537, OP Type: Add, Name: /tblocks/tblocks.4/norm1/Add_1 Group 399: Order: 538, OP Type: MatMul, Name: /tblocks/tblocks.4/ff/ff.0/MatMul Order: 539, OP Type: Add, Name: /tblocks/tblocks.4/ff/ff.0/Add Order: 540, OP Type: Relu, Name: /tblocks/tblocks.4/ff/ff.1/Relu Group 400: Order: 541, OP Type: MatMul, Name: /tblocks/tblocks.4/ff/ff.2/MatMul Order: 542, OP Type: Add, Name: /tblocks/tblocks.4/ff/ff.2/Add Order: 543, OP Type: Add, Name: /tblocks/tblocks.4/Add_1 Order: 544, OP Type: ReduceMean, Name: /tblocks/tblocks.4/norm2/ReduceMean Order: 545, OP Type: Sub, Name: /tblocks/tblocks.4/norm2/Sub Order: 546, OP Type: Constant, Name: /tblocks/tblocks.4/norm2/Constant Order: 547, OP Type: Pow, Name: /tblocks/tblocks.4/norm2/Pow Order: 548, OP Type: ReduceMean, Name: /tblocks/tblocks.4/norm2/ReduceMean_1 Order: 549, OP Type: Constant, Name: /tblocks/tblocks.4/norm2/Constant_1 Order: 550, OP Type: Add, Name: /tblocks/tblocks.4/norm2/Add Order: 551, OP Type: Sqrt, Name: /tblocks/tblocks.4/norm2/Sqrt Order: 552, OP Type: Div, Name: /tblocks/tblocks.4/norm2/Div Order: 553, OP Type: Mul, Name: /tblocks/tblocks.4/norm2/Mul Order: 554, OP Type: Add, Name: /tblocks/tblocks.4/norm2/Add_1 Group 401: Order: 555, OP Type: Shape, Name: /tblocks/tblocks.5/attention/Shape Group 402: Order: 556, OP Type: Constant, Name: /tblocks/tblocks.5/attention/Constant Group 403: Order: 557, OP Type: Gather, Name: /tblocks/tblocks.5/attention/Gather Group 404: Order: 558, OP Type: Shape, Name: /tblocks/tblocks.5/attention/Shape_1 Group 405: Order: 559, OP Type: Constant, Name: /tblocks/tblocks.5/attention/Constant_1 Group 406: Order: 560, OP Type: Gather, Name: /tblocks/tblocks.5/attention/Gather_1 Group 407: Order: 561, OP Type: Shape, Name: /tblocks/tblocks.5/attention/Shape_2 Group 408: Order: 562, OP Type: Constant, Name: /tblocks/tblocks.5/attention/Constant_2 Group 409: Order: 563, OP Type: Gather, Name: /tblocks/tblocks.5/attention/Gather_2 Group 410: Order: 564, OP Type: Constant, Name: /tblocks/tblocks.5/attention/Constant_3 Group 411: Order: 565, OP Type: Div, Name: /tblocks/tblocks.5/attention/Div Group 412: Order: 566, OP Type: Cast, Name: /tblocks/tblocks.5/attention/Cast Group 413: Order: 567, OP Type: Cast, Name: /tblocks/tblocks.5/attention/Cast_1 Group 414: Order: 568, OP Type: MatMul, Name: /tblocks/tblocks.5/attention/tokeys/MatMul Group 415: Order: 569, OP Type: MatMul, Name: /tblocks/tblocks.5/attention/toqueries/MatMul Group 416: Order: 570, OP Type: MatMul, Name: /tblocks/tblocks.5/attention/tovalues/MatMul Group 417: Order: 571, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze Group 418: Order: 572, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_1 Group 419: Order: 573, OP Type: Constant, Name: /tblocks/tblocks.5/attention/Constant_4 Group 420: Order: 574, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_2 Group 421: Order: 575, OP Type: Concat, Name: /tblocks/tblocks.5/attention/Concat Group 422: Order: 576, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_3 Group 423: Order: 577, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_4 Group 424: Order: 578, OP Type: Constant, Name: /tblocks/tblocks.5/attention/Constant_5 Group 425: Order: 579, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_5 Group 426: Order: 580, OP Type: Concat, Name: /tblocks/tblocks.5/attention/Concat_1 Group 427: Order: 581, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_6 Group 428: Order: 582, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_7 Group 429: Order: 583, OP Type: Constant, Name: /tblocks/tblocks.5/attention/Constant_6 Group 430: Order: 584, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_8 Group 431: Order: 585, OP Type: Concat, Name: /tblocks/tblocks.5/attention/Concat_2 Group 432: Order: 586, OP Type: Reshape, Name: /tblocks/tblocks.5/attention/Reshape Group 433: Order: 587, OP Type: Reshape, Name: /tblocks/tblocks.5/attention/Reshape_1 Group 434: Order: 588, OP Type: Reshape, Name: /tblocks/tblocks.5/attention/Reshape_2 Group 435: Order: 589, OP Type: Transpose, Name: /tblocks/tblocks.5/attention/Transpose Group 436: Order: 590, OP Type: Constant, Name: /tblocks/tblocks.5/attention/Constant_7 Group 437: Order: 591, OP Type: Mul, Name: /tblocks/tblocks.5/attention/Mul Group 438: Order: 592, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_9 Group 439: Order: 593, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_10 Group 440: Order: 594, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_11 Group 441: Order: 595, OP Type: Concat, Name: /tblocks/tblocks.5/attention/Concat_3 Group 442: Order: 596, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_12 Group 443: Order: 597, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_13 Group 444: Order: 598, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_14 Group 445: Order: 599, OP Type: Concat, Name: /tblocks/tblocks.5/attention/Concat_4 Group 446: Order: 600, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_15 Group 447: Order: 601, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_16 Group 448: Order: 602, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_17 Group 449: Order: 603, OP Type: Concat, Name: /tblocks/tblocks.5/attention/Concat_5 Group 450: Order: 604, OP Type: Reshape, Name: /tblocks/tblocks.5/attention/Reshape_3 Group 451: Order: 605, OP Type: Transpose, Name: /tblocks/tblocks.5/attention/Transpose_1 Group 452: Order: 606, OP Type: Reshape, Name: /tblocks/tblocks.5/attention/Reshape_4 Group 453: Order: 607, OP Type: Transpose, Name: /tblocks/tblocks.5/attention/Transpose_2 Group 454: Order: 608, OP Type: Reshape, Name: /tblocks/tblocks.5/attention/Reshape_5 Group 455: Order: 609, OP Type: Transpose, Name: /tblocks/tblocks.5/attention/Transpose_3 Group 456: Order: 610, OP Type: MatMul, Name: /tblocks/tblocks.5/attention/MatMul Order: 611, OP Type: Constant, Name: /tblocks/tblocks.5/attention/Constant_8 Order: 612, OP Type: Mul, Name: /tblocks/tblocks.5/attention/Mul_1 Order: 613, OP Type: Softmax, Name: /tblocks/tblocks.5/attention/Softmax Group 457: Order: 614, OP Type: MatMul, Name: /tblocks/tblocks.5/attention/MatMul_1 Group 458: Order: 615, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_18 Group 459: Order: 616, OP Type: Constant, Name: /tblocks/tblocks.5/attention/Constant_9 Group 460: Order: 617, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_19 Group 461: Order: 618, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_20 Group 462: Order: 619, OP Type: Concat, Name: /tblocks/tblocks.5/attention/Concat_6 Group 463: Order: 620, OP Type: Reshape, Name: /tblocks/tblocks.5/attention/Reshape_6 Group 464: Order: 621, OP Type: Transpose, Name: /tblocks/tblocks.5/attention/Transpose_4 Group 465: Order: 622, OP Type: Constant, Name: /tblocks/tblocks.5/attention/Constant_10 Group 466: Order: 623, OP Type: Mul, Name: /tblocks/tblocks.5/attention/Mul_2 Group 467: Order: 624, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_21 Group 468: Order: 625, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_22 Group 469: Order: 626, OP Type: Unsqueeze, Name: /tblocks/tblocks.5/attention/Unsqueeze_23 Group 470: Order: 627, OP Type: Concat, Name: /tblocks/tblocks.5/attention/Concat_7 Group 471: Order: 628, OP Type: Reshape, Name: /tblocks/tblocks.5/attention/Reshape_7 Group 472: Order: 629, OP Type: MatMul, Name: /tblocks/tblocks.5/attention/unifyheads/MatMul Order: 630, OP Type: Add, Name: /tblocks/tblocks.5/attention/unifyheads/Add Order: 631, OP Type: Add, Name: /tblocks/tblocks.5/Add Order: 632, OP Type: ReduceMean, Name: /tblocks/tblocks.5/norm1/ReduceMean Order: 633, OP Type: Sub, Name: /tblocks/tblocks.5/norm1/Sub Order: 634, OP Type: Constant, Name: /tblocks/tblocks.5/norm1/Constant Order: 635, OP Type: Pow, Name: /tblocks/tblocks.5/norm1/Pow Order: 636, OP Type: ReduceMean, Name: /tblocks/tblocks.5/norm1/ReduceMean_1 Order: 637, OP Type: Constant, Name: /tblocks/tblocks.5/norm1/Constant_1 Order: 638, OP Type: Add, Name: /tblocks/tblocks.5/norm1/Add Order: 639, OP Type: Sqrt, Name: /tblocks/tblocks.5/norm1/Sqrt Order: 640, OP Type: Div, Name: /tblocks/tblocks.5/norm1/Div Order: 641, OP Type: Mul, Name: /tblocks/tblocks.5/norm1/Mul Order: 642, OP Type: Add, Name: /tblocks/tblocks.5/norm1/Add_1 Group 473: Order: 643, OP Type: MatMul, Name: /tblocks/tblocks.5/ff/ff.0/MatMul Order: 644, OP Type: Add, Name: /tblocks/tblocks.5/ff/ff.0/Add Order: 645, OP Type: Relu, Name: /tblocks/tblocks.5/ff/ff.1/Relu Group 474: Order: 646, OP Type: MatMul, Name: /tblocks/tblocks.5/ff/ff.2/MatMul Order: 647, OP Type: Add, Name: /tblocks/tblocks.5/ff/ff.2/Add Order: 648, OP Type: Add, Name: /tblocks/tblocks.5/Add_1 Order: 649, OP Type: ReduceMean, Name: /tblocks/tblocks.5/norm2/ReduceMean Order: 650, OP Type: Sub, Name: /tblocks/tblocks.5/norm2/Sub Order: 651, OP Type: Constant, Name: /tblocks/tblocks.5/norm2/Constant Order: 652, OP Type: Pow, Name: /tblocks/tblocks.5/norm2/Pow Order: 653, OP Type: ReduceMean, Name: /tblocks/tblocks.5/norm2/ReduceMean_1 Order: 654, OP Type: Constant, Name: /tblocks/tblocks.5/norm2/Constant_1 Order: 655, OP Type: Add, Name: /tblocks/tblocks.5/norm2/Add Order: 656, OP Type: Sqrt, Name: /tblocks/tblocks.5/norm2/Sqrt Order: 657, OP Type: Div, Name: /tblocks/tblocks.5/norm2/Div Order: 658, OP Type: Mul, Name: /tblocks/tblocks.5/norm2/Mul Order: 659, OP Type: Add, Name: /tblocks/tblocks.5/norm2/Add_1 Order: 660, OP Type: ReduceMean, Name: /ReduceMean Order: 661, OP Type: Gemm, Name: /toprobs/Gemm Order: 662, OP Type: LogSoftmax, Name: /LogSoftmax
Editor is loading...
Leave a Comment