Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AIEX] Shift G_CONCAT_VECTORS closer to the user #234

Open
wants to merge 1 commit into
base: aie-public
Choose a base branch
from

Conversation

andcarminati
Copy link
Collaborator

When commiting applyUpdToConcat. This enables more postinc combiner cases.

When commiting applyUpdToConcat. This enables more postinc combiner cases.
@andcarminati
Copy link
Collaborator Author

QoR results:

|--------------------------|--------------|-----------------------|--------------|-----------------------|--------------|--------------------|-------------------------|-------------------------|--------------|--------------|--------------|--------------|--------------------|--------------------|--------------|--------------|------------------------------------|------------------------------------|----------------|----------------------------|------------------------|--------------|---------------------------|---------------------------|---------------------------|-----------------------|---------------|---------------|-------------------------|-------------------------|--------------------|-------------------|-------------------|------------------|----------------------|--------------------|----------------------|----------------|------------------|--------------------|----------------|-----------------------------|-----------------------------|----------------|----------------|-------------------------------------------|-------------------------------------------|--------------------------------------------------------------|----------------------------------------------------------|--------------------------------------------------|----------------------------------------------|--------------------------------------------------|----------------------------------------------|------------------------------------------------------------|-----------------------------------------------|-----------------------|-----------------------|-----------------------|-----------------------|--------------|-----------------------|-----------------------|------------------|------------------|-------------------------|-------------------------|------------------|------------------|--------------|--------------|----------------|----------------|---------------|---------------|--------------------------|--------------------------|--------------------|--------------|------------------------------|------------------------------|---------------|---------------|----------------------|----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------|--------------------------------------|--------------------------------------|------------------------|------------------------|----------------------|------------------|----------------------|------------------|----------------|----------------|-----------------|-----------------|-----------------|-----------------|-------------------------------|--------------|--------------|----------------------|------------------|--------------|--------------|------------------------|------------------------|--------------|--------------|--------------|--------------|--------------|--------------|-------------------------|-------------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|-----------------------------|-----------------------------|--------------------|--------------------|--------------------|--------------------|-------------------------------|-------------------------------|------------------|------------------|-------------------------------|-------------------------------|-------------------------------|-------------------------------|-----------------------------------|-------------------------------|------------------------------|------------------------------|------------------------------|------------------------------|--------------|--------------|--------------|--------------|-------------------|----------------------|--------------|--------------|------------------|------------------|--------------------|----------------|---------------|--------------|--------------|--------------|--------------|--------------------------------------|--------------------------------------|----------------|----------------------------|------------------------|--------------|--------------|--------------|--------------|--------------|--------------|---------------------|-----------------|------------------------|-----------------------|-----------------------|--------------------------------------|--------------------------------------|--------------|--------------|--------------|-----------------------|-----------------------|-------------------|-------------------|-------------------|-------------------|------------------|------------------|------------------|------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|-----------------------|-----------------------|------------------|------------------|------------------|------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|------------------|------------------|------------------|------------------|--------------|--------------|---------------------|--------------|--------------|-------------------|-------------------|--------------|--------------|------------------|------------------|------------------|------------------|---------------|---------------|----------------|----------------|------------------|-------------------------|-------------------------|-------------------------|----------------|----------------|----------------|----------------|--------------|--------------|--------------|--------------|---------------|------------------|--------------|--------------|----------------|----------------|--------------|--------------|--------------|--------------|--------------------|----------------|--------------------------------------|--------------------------------------|-----------------------------|-----------------------------|-------------------------------------------|-----------------|-----------------|-------------------------------|-----------------------------|-------------------------|--------------|--------------|--------------|--------------|-------------------------------|---------------------------|------------------|------------------|---------------|---------------|---------------|---------------|---------------|---------------|---------------|---------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|--------------|--------------|--------------|--------------|--------------|--------------|--------------------|--------------|--------------------|--------------|--------------|------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|
| Core_Compute_Cycle_Count | AvgPool2D_0  | AvgPool2D_aie2_int8_0 | AvgPool2D_1  | AvgPool2D_aie2_int8_1 | Conv2D_2x8_1 | Conv2D_edge_mode_0 | Conv2D_Transpose_AIE2_1 | Conv2D_Transpose_AIE2_0 | Abs_bf16_0   | Abs_int8_0   | Add2D_0      | Add2D_1      | Add2D_Standalone_0 | Add2D_Standalone_1 | Add2D_bf16_0 | Add2D_bf16_1 | AddAttributeBroadcasting_aie2_bf16 | AddAttributeBroadcasting_aie2_int8 | AddBf16_aie2_0 | AddBroadcastingBf16_aie2_0 | AddBroadcasting_aie2_0 | Add_aie2_0   | AvgPool2D_aie2_bfloat16_0 | AvgPool2D_aie2_bfloat16_1 | BatchNorm1d_aie2_bfloat16 | BatchNorm1d_aie2_int8 | BatchNorm2D_0 | BatchNorm2D_1 | BilinearInterpolation_0 | BilinearInterpolation_1 | BitShift_AIE2_int8 | BitwiseAnd_int8_0 | BitwiseNot_aie2_0 | BitwiseOr_int8_0 | BitwiseXor_aie2_int8 | Cast_aie2_bfloat16 | Cast_aie2_bfloat16_1 | Cast_aie2_int8 | Cast_aie2_int8_1 | Ceil_AIE2_bfloat16 | Ceil_AIE2_int8 | ChannelsFirstFlatten_bf16_0 | ChannelsFirstFlatten_int8_0 | Clip_aie2_bf16 | Clip_aie2_int8 | CompareOpsAttributeBroadcasting_aie2_bf16 | CompareOpsAttributeBroadcasting_aie2_int8 | CompareOpsBroadcasting_K_EQ_GE_GT_LE_LT_CMP_GE_bfloat16_aie2 | CompareOpsBroadcasting_K_EQ_GE_GT_LE_LT_CMP_GE_int8_aie2 | CompareOps_K_EQ_GE_GT_LE_LT_CMP_EQ_bfloat16_aie2 | CompareOps_K_EQ_GE_GT_LE_LT_CMP_EQ_int8_aie2 | CompareOps_K_EQ_GE_GT_LE_LT_CMP_GE_bfloat16_aie2 | CompareOps_K_EQ_GE_GT_LE_LT_CMP_GE_int8_aie2 | CompareOps_K_EQ_GE_GT_LE_LT_CMP_GE_int8_aie2_ptr_interface | CompareOps_K_EQ_GE_GT_LE_LT_CMP_GT_int32_aie2 | Conv1D_DW_AIE2_bf16_0 | Conv1D_DW_AIE2_bf16_1 | Conv1D_DW_AIE2_int8_0 | Conv1D_DW_AIE2_int8_1 | Conv2D_0     | Conv2D_7x7s2_Layer1_0 | Conv2D_7x7s2_Layer1_1 | Conv2D_11x11s4_0 | Conv2D_11x11s4_1 | Conv2D_11x11s4_Layer1_0 | Conv2D_11x11s4_Layer1_1 | Conv2D_DW_bf16_0 | Conv2D_DW_bf16_1 | Conv2D_FC_0  | Conv2D_FC_1  | Conv2D_LReLU_0 | Conv2D_LReLU_1 | Conv2D_ReLU_0 | Conv2D_ReLU_1 | Conv2D_ReLU_Standalone_0 | Conv2D_ReLU_Standalone_1 | Conv2D_ReLU_int8_1 | Conv2D_SV60  | Conv2D_Transpose_bf16_AIE2_0 | Conv2D_Transpose_bf16_AIE2_1 | Conv2D_bf16_0 | Conv2D_bf16_1 | Conv2D_mixed_batch_0 | Conv2D_mixed_batch_1 | DegroupG4_aie2_bf16_0 | DegroupG4_aie2_bf16_1 | DegroupG4_aie2_int8_0 | DegroupG4_aie2_int8_1 | DegroupG8_aie2_bf16_0 | DegroupG8_aie2_bf16_1 | DegroupG8_aie2_int8_0 | DegroupG8_aie2_int8_1 | DilatedConv2D_1 | DivAttributeBroadcasting_aie2_bf16_0 | DivAttributeBroadcasting_aie2_int8_0 | DivBroadcasting_aie2_0 | DivBroadcasting_aie2_1 | EleMax_aie2_bfloat16 | EleMax_aie2_int8 | EleMin_aie2_bfloat16 | EleMin_aie2_int8 | ElemDiv_aie2_0 | ElemDiv_aie2_1 | Elu_aie2_bf16_0 | Elu_aie2_int8_0 | Erf_aie2_bf16_0 | Erf_aie2_int8_0 | Erf_aie2_int8_0_ptr_interface | Exp_bf16_0   | Exp_bf16_1   | Expand_aie2_bfloat16 | Expand_aie2_int8 | Floor_aie2_0 | Floor_aie2_1 | FullyConnect_aie2_bf16 | FullyConnect_aie2_int8 | GELU_0       | GELU_1       | GEMM_int8_0  | GEMM_int8_1  | GEMV_0       | GEMV_1       | GeluTemplated_aie2_bf16 | GeluTemplated_aie2_int8 | GroupG4_aie2_bf16_0 | GroupG4_aie2_bf16_1 | GroupG4_aie2_int8_0 | GroupG4_aie2_int8_1 | GroupG8_aie2_bf16_0 | GroupG8_aie2_bf16_1 | GroupG8_aie2_int8_0 | GroupG8_aie2_int8_1 | HardSigmoidTemplated_bf16_0 | HardSigmoidTemplated_int8_0 | HardSigmoid_bf16_0 | HardSigmoid_bf16_1 | HardSigmoid_int8_0 | HardSigmoid_int8_1 | HardswishAsHardsigmoid_aie2_0 | HardswishAsHardsigmoid_aie2_1 | Hardswish_aie2_0 | Hardswish_aie2_1 | InstanceNormPart1_aie2_bf16_0 | InstanceNormPart1_aie2_int8_0 | InstanceNormPart2_aie2_bf16_0 | InstanceNormPart2_aie2_int8_0 | InterpolateLinear1D_AIE2_bfloat16 | InterpolateLinear1D_AIE2_int8 | LayerNormC8Part1_aie2_bf16_0 | LayerNormC8Part1_aie2_int8_0 | LayerNormC8Part2_aie2_bf16_0 | LayerNormC8Part2_aie2_int8_0 | LayerNorm_0  | LayerNorm_1  | Log_bf16_0   | Log_int8_0   | LogicalNot_aie2_0 | LogicalXor_aie2_int8 | MaxPool2D_0  | MaxPool2D_1  | MaxPool2D_bf16_0 | MaxPool2D_bf16_1 | Mish_aie2_bfloat16 | Mish_aie2_int8 | Mod_aie2_bf16 | Mul2D_0      | Mul2D_1      | Mul2d_bf16_0 | Mul2d_bf16_1 | MulAttributeBroadcasting_aie2_bf16_0 | MulAttributeBroadcasting_aie2_int8_0 | MulBf16_aie2_0 | MulBroadcastingBf16_aie2_0 | MulBroadcasting_aie2_0 | Mul_aie2_0   | Neg_aie2_0   | Neg_aie2_1   | Pad2D_0      | Pad2D_1      | Pad2D_bf16_0 | Pad3D_AIE2_bfloat16 | Pad3D_AIE2_int8 | PixelShuffle_aie2_int8 | PixelUnshuffle_bf16_0 | PixelUnshuffle_int8_0 | PowAttributeBroadcasting_aie2_bf16_0 | PowAttributeBroadcasting_aie2_int8_0 | Pow_bf16_0   | Pow_bf16_1   | Pow_int8_0   | Range_bfloat16_aie2_0 | Range_bfloat16_aie2_1 | Range_int8_aie2_0 | Range_int8_aie2_1 | Reciprocal_aie2_0 | Reciprocal_aie2_1 | ReduceMax_bf16_0 | ReduceMax_bf16_1 | ReduceMax_int8_0 | ReduceMax_int8_1 | ReduceMeanAxis_1_aie2_bf16 | ReduceMeanAxis_1_aie2_int8 | ReduceMeanAxis_2_aie2_bf16 | ReduceMeanAxis_2_aie2_int8 | ReduceMeanAxis_3_aie2_bf16 | ReduceMeanAxis_3_aie2_int8 | ReduceMeanAxis_4_aie2_bf16 | ReduceMeanAxis_4_aie2_int8 | ReduceMeanAxis_5_aie2_bf16 | ReduceMeanAxis_5_aie2_int8 | ReduceMeanAxis_6_aie2_bf16 | ReduceMeanAxis_6_aie2_int8 | ReduceMeanAxis_7_aie2_bf16 | ReduceMeanAxis_7_aie2_int8 | ReduceMin1D_aie2_bf16 | ReduceMin1D_aie2_int8 | ReduceMin_bf16_0 | ReduceMin_bf16_1 | ReduceMin_int8_0 | ReduceMin_int8_1 | ReduceProdAxis_1_aie2_bf16 | ReduceProdAxis_2_aie2_bf16 | ReduceProdAxis_3_aie2_bf16 | ReduceProdAxis_4_aie2_bf16 | ReduceProdAxis_5_aie2_bf16 | ReduceProdAxis_6_aie2_bf16 | ReduceProdAxis_7_aie2_bf16 | ReduceSumAxis_1_aie2_bf16 | ReduceSumAxis_1_aie2_int8 | ReduceSumAxis_2_aie2_bf16 | ReduceSumAxis_2_aie2_int8 | ReduceSumAxis_3_aie2_bf16 | ReduceSumAxis_3_aie2_int8 | ReduceSumAxis_4_aie2_bf16 | ReduceSumAxis_4_aie2_int8 | ReduceSumAxis_5_aie2_bf16 | ReduceSumAxis_5_aie2_int8 | ReduceSumAxis_6_aie2_bf16 | ReduceSumAxis_6_aie2_int8 | ReduceSumAxis_7_aie2_bf16 | ReduceSumAxis_7_aie2_int8 | ReduceSum_bf16_0 | ReduceSum_bf16_1 | ReduceSum_int8_0 | ReduceSum_int8_1 | Requantize_0 | Requantize_1 | Rescale_aie2_int8_0 | Round_aie2_0 | Round_aie2_1 | Rsqrt_aie2_bf16_0 | Rsqrt_aie2_int8_0 | Scale_Add_0  | Scale_Add_1  | Scale_Add_bf16_0 | Scale_Add_bf16_1 | Select_aie2_bf16 | Select_aie2_int8 | Shrink_aie2_0 | Shrink_aie2_1 | SiLU_aie2_bf16 | SiLU_aie2_int8 | SiLU_aie2_int8_1 | SigmoidTemplated_bf16_0 | SigmoidTemplated_int8_0 | SigmoidTemplated_int8_1 | Sigmoid_bf16_0 | Sigmoid_bf16_1 | Sigmoid_int8_0 | Sigmoid_int8_1 | Sign_bf16_0  | Sign_bf16_1  | Sign_int8_0  | Sign_int8_1  | Sin_aie2_bf16 | Slice_bfloat16_0 | Slice_int8_0 | Softmax_1    | Softmax_bf16_0 | Softmax_bf16_1 | Sqrt_bf16_0  | Sqrt_bf16_1  | Sqrt_int8_0  | Sqrt_int8_1  | Squeeze_bfloat16_0 | Squeeze_int8_0 | SubAttributeBroadcasting_aie2_bf16_0 | SubAttributeBroadcasting_aie2_int8_0 | SubBroadcasting_aie2_bf16_0 | SubBroadcasting_aie2_int8_0 | SubBroadcasting_aie2_int8_0_ptr_interface | Sub_aie2_bf16_0 | Sub_aie2_int8_0 | Sub_aie2_int8_0_ptr_interface | TanhTemplated_aie2_bfloat16 | TanhTemplated_aie2_int8 | Tanh_0       | Tanh_1       | Tanh_int8_0  | Tanh_int8_1  | ThresholdedRelu_aie2_bfloat16 | ThresholdedRelu_aie2_int8 | Tile_aie2_bf16_0 | Tile_aie2_int8_1 | Topk1D_bf16_0 | Topk1D_bf16_1 | Topk1D_int8_0 | Topk1D_int8_1 | Topk2D_bf16_0 | Topk2D_bf16_1 | Topk2D_int8_0 | Topk2D_int8_1 | Transpose_aie2_bf16_021 | Transpose_aie2_bf16_021_pad | Transpose_aie2_bf16_102 | Transpose_aie2_bf16_102_pad | Transpose_aie2_bf16_120 | Transpose_aie2_bf16_120_pad | Transpose_aie2_bf16_201 | Transpose_aie2_bf16_201_pad | Transpose_aie2_bf16_210 | Transpose_aie2_bf16_210_pad | Transpose_aie2_int8_021 | Transpose_aie2_int8_021_pad | Transpose_aie2_int8_102 | Transpose_aie2_int8_102_pad | Transpose_aie2_int8_120 | Transpose_aie2_int8_120_pad | Transpose_aie2_int8_201 | Transpose_aie2_int8_201_pad | Transpose_aie2_int8_210 | Transpose_aie2_int8_210_pad | bfloat16     | int8         | GEMM_bf16_0  | GEMM_bf16_1  | Conv2D_DW_1  | Conv2D_DW_0  | Conv2D_edge_mode_1 | Conv2D_2x8_0 | Conv2D_ReLU_int8_0 | Conv2D_1     | Averege diff | Diff stdev | Quantile #1 | Quantile #2 | Quantile #3 | Quantile #4 | Quantile #5 | Quantile #6 | Quantile #7 | Quantile #8 | Quantile #9 |
|--------------------------|--------------|-----------------------|--------------|-----------------------|--------------|--------------------|-------------------------|-------------------------|--------------|--------------|--------------|--------------|--------------------|--------------------|--------------|--------------|------------------------------------|------------------------------------|----------------|----------------------------|------------------------|--------------|---------------------------|---------------------------|---------------------------|-----------------------|---------------|---------------|-------------------------|-------------------------|--------------------|-------------------|-------------------|------------------|----------------------|--------------------|----------------------|----------------|------------------|--------------------|----------------|-----------------------------|-----------------------------|----------------|----------------|-------------------------------------------|-------------------------------------------|--------------------------------------------------------------|----------------------------------------------------------|--------------------------------------------------|----------------------------------------------|--------------------------------------------------|----------------------------------------------|------------------------------------------------------------|-----------------------------------------------|-----------------------|-----------------------|-----------------------|-----------------------|--------------|-----------------------|-----------------------|------------------|------------------|-------------------------|-------------------------|------------------|------------------|--------------|--------------|----------------|----------------|---------------|---------------|--------------------------|--------------------------|--------------------|--------------|------------------------------|------------------------------|---------------|---------------|----------------------|----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------|--------------------------------------|--------------------------------------|------------------------|------------------------|----------------------|------------------|----------------------|------------------|----------------|----------------|-----------------|-----------------|-----------------|-----------------|-------------------------------|--------------|--------------|----------------------|------------------|--------------|--------------|------------------------|------------------------|--------------|--------------|--------------|--------------|--------------|--------------|-------------------------|-------------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|-----------------------------|-----------------------------|--------------------|--------------------|--------------------|--------------------|-------------------------------|-------------------------------|------------------|------------------|-------------------------------|-------------------------------|-------------------------------|-------------------------------|-----------------------------------|-------------------------------|------------------------------|------------------------------|------------------------------|------------------------------|--------------|--------------|--------------|--------------|-------------------|----------------------|--------------|--------------|------------------|------------------|--------------------|----------------|---------------|--------------|--------------|--------------|--------------|--------------------------------------|--------------------------------------|----------------|----------------------------|------------------------|--------------|--------------|--------------|--------------|--------------|--------------|---------------------|-----------------|------------------------|-----------------------|-----------------------|--------------------------------------|--------------------------------------|--------------|--------------|--------------|-----------------------|-----------------------|-------------------|-------------------|-------------------|-------------------|------------------|------------------|------------------|------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|-----------------------|-----------------------|------------------|------------------|------------------|------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|------------------|------------------|------------------|------------------|--------------|--------------|---------------------|--------------|--------------|-------------------|-------------------|--------------|--------------|------------------|------------------|------------------|------------------|---------------|---------------|----------------|----------------|------------------|-------------------------|-------------------------|-------------------------|----------------|----------------|----------------|----------------|--------------|--------------|--------------|--------------|---------------|------------------|--------------|--------------|----------------|----------------|--------------|--------------|--------------|--------------|--------------------|----------------|--------------------------------------|--------------------------------------|-----------------------------|-----------------------------|-------------------------------------------|-----------------|-----------------|-------------------------------|-----------------------------|-------------------------|--------------|--------------|--------------|--------------|-------------------------------|---------------------------|------------------|------------------|---------------|---------------|---------------|---------------|---------------|---------------|---------------|---------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|--------------|--------------|--------------|--------------|--------------|--------------|--------------------|--------------|--------------------|--------------|--------------|------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|
| aie-public               |         1068 |                  1068 |          780 |                   780 |         3822 |              30301 |                   14441 |                   53845 |          376 |          510 |          217 |          435 |                322 |                482 |          254 |          298 |                                762 |                                807 |            673 |                        728 |                    776 |          726 |                      3247 |                      2247 |                       390 |                   408 |           308 |           416 |                     667 |                     361 |               2008 |               467 |               135 |              467 |                  710 |                974 |                  974 |            725 |              725 |               1413 |            446 |                       13604 |                       11932 |            227 |            246 |                                      1499 |                                      1185 |                                                         1455 |                                                      960 |                                             1462 |                                          967 |                                             1474 |                                          978 |                                                        978 |                                          1098 |                  3358 |                  3902 |                  1539 |                  1773 |         7695 |                  5886 |                  1613 |             5785 |             5420 |                    4275 |                    2979 |             1177 |             3894 |         2650 |         1143 |           2175 |           5263 |          1276 |         27511 |                     1276 |                     2533 |                927 |          858 |                       433874 |                         6292 |         23279 |         38224 |                11096 |                21520 |                   603 |                   990 |                   364 |                   558 |                   747 |                  1149 |                   436 |                   637 |            5391 |                                 5372 |                                 7802 |                   2059 |                   1450 |                  227 |              164 |                  227 |              164 |           2001 |           1388 |            2605 |             579 |            2770 |            2554 |                          2533 |         6048 |         1229 |                 1960 |             1907 |          315 |          881 |                   1090 |                    829 |         2144 |         2811 |         2797 |        32931 |          469 |          387 |                    1389 |                    1214 |                 495 |                1532 |                 312 |                 828 |                1026 |                1659 |                 555 |                 891 |                         556 |                         284 |                937 |                649 |                417 |                427 |                          1370 |                          1527 |             1370 |             1522 |                          2919 |                         11387 |                          9536 |                         11508 |                             14467 |                         11967 |                         8982 |                         7834 |                        11278 |                        11222 |        19133 |        16195 |         4149 |         1617 |               225 |                  528 |         1468 |         1260 |             1797 |             1269 |               5479 |           9495 |          5249 |          533 |          533 |          519 |          327 |                                  893 |                                  517 |            697 |                        752 |                    294 |          231 |          779 |          455 |          568 |         1684 |         2394 |                9208 |            9595 |                   7280 |                 17147 |                 14571 |                                40463 |                                 4312 |        34190 |        34196 |         4312 |                  4065 |                  2669 |              1224 |              1846 |              1231 |              2155 |             7193 |             9433 |            14509 |            19315 |                      13116 |                       7531 |                      13152 |                       7592 |                       7245 |                       3024 |                      13122 |                       7557 |                       7224 |                       3041 |                       7231 |                       3020 |                       6263 |                       2255 |                   188 |                   164 |             7193 |            18469 |             8797 |            19069 |                      35466 |                      17821 |                       8722 |                      35498 |                       8730 |                       8709 |                       1794 |                     11960 |                      7244 |                     11981 |                      7281 |                      7066 |                      2971 |                     11996 |                      7305 |                      7069 |                      2974 |                      7052 |                      2947 |                      6212 |                      2215 |            12209 |            12209 |            19670 |            11400 |         1421 |          781 |                 233 |          367 |         1092 |              3605 |              2380 |          374 |          374 |             1709 |             1709 |              329 |              206 |           658 |           759 |           2908 |           2969 |             2967 |                    1633 |                    1277 |                    1277 |           2627 |           1727 |             91 |            110 |         1078 |          210 |          416 |          122 |          3015 |              945 |         1545 |          426 |           6352 |           1583 |        29778 |         3794 |        19164 |        19164 |                207 |            207 |                                  762 |                                  807 |                         706 |                         754 |                                       754 |             651 |             704 |                           704 |                        1050 |                     300 |         1970 |         2578 |          339 |          407 |                           514 |                       867 |             4264 |             2595 |          1217 |           169 |           836 |           118 |         34469 |           303 |         30723 |           252 |                    1856 |                        2338 |                    1155 |                        1140 |                    1856 |                        1752 |                    1871 |                        1767 |                    1868 |                        1868 |                    2685 |                        3612 |                    1149 |                        1089 |                    2686 |                        2686 |                    2700 |                        2544 |                    2694 |                        2538 |         1217 |          849 |         3622 |         7669 |          853 |         2941 |              18726 |         1819 |              10164 |         2450 |              |            |             |             |             |             |             |             |             |             |             |
|--------------------------|--------------|-----------------------|--------------|-----------------------|--------------|--------------------|-------------------------|-------------------------|--------------|--------------|--------------|--------------|--------------------|--------------------|--------------|--------------|------------------------------------|------------------------------------|----------------|----------------------------|------------------------|--------------|---------------------------|---------------------------|---------------------------|-----------------------|---------------|---------------|-------------------------|-------------------------|--------------------|-------------------|-------------------|------------------|----------------------|--------------------|----------------------|----------------|------------------|--------------------|----------------|-----------------------------|-----------------------------|----------------|----------------|-------------------------------------------|-------------------------------------------|--------------------------------------------------------------|----------------------------------------------------------|--------------------------------------------------|----------------------------------------------|--------------------------------------------------|----------------------------------------------|------------------------------------------------------------|-----------------------------------------------|-----------------------|-----------------------|-----------------------|-----------------------|--------------|-----------------------|-----------------------|------------------|------------------|-------------------------|-------------------------|------------------|------------------|--------------|--------------|----------------|----------------|---------------|---------------|--------------------------|--------------------------|--------------------|--------------|------------------------------|------------------------------|---------------|---------------|----------------------|----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------|--------------------------------------|--------------------------------------|------------------------|------------------------|----------------------|------------------|----------------------|------------------|----------------|----------------|-----------------|-----------------|-----------------|-----------------|-------------------------------|--------------|--------------|----------------------|------------------|--------------|--------------|------------------------|------------------------|--------------|--------------|--------------|--------------|--------------|--------------|-------------------------|-------------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|-----------------------------|-----------------------------|--------------------|--------------------|--------------------|--------------------|-------------------------------|-------------------------------|------------------|------------------|-------------------------------|-------------------------------|-------------------------------|-------------------------------|-----------------------------------|-------------------------------|------------------------------|------------------------------|------------------------------|------------------------------|--------------|--------------|--------------|--------------|-------------------|----------------------|--------------|--------------|------------------|------------------|--------------------|----------------|---------------|--------------|--------------|--------------|--------------|--------------------------------------|--------------------------------------|----------------|----------------------------|------------------------|--------------|--------------|--------------|--------------|--------------|--------------|---------------------|-----------------|------------------------|-----------------------|-----------------------|--------------------------------------|--------------------------------------|--------------|--------------|--------------|-----------------------|-----------------------|-------------------|-------------------|-------------------|-------------------|------------------|------------------|------------------|------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|-----------------------|-----------------------|------------------|------------------|------------------|------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|------------------|------------------|------------------|------------------|--------------|--------------|---------------------|--------------|--------------|-------------------|-------------------|--------------|--------------|------------------|------------------|------------------|------------------|---------------|---------------|----------------|----------------|------------------|-------------------------|-------------------------|-------------------------|----------------|----------------|----------------|----------------|--------------|--------------|--------------|--------------|---------------|------------------|--------------|--------------|----------------|----------------|--------------|--------------|--------------|--------------|--------------------|----------------|--------------------------------------|--------------------------------------|-----------------------------|-----------------------------|-------------------------------------------|-----------------|-----------------|-------------------------------|-----------------------------|-------------------------|--------------|--------------|--------------|--------------|-------------------------------|---------------------------|------------------|------------------|---------------|---------------|---------------|---------------|---------------|---------------|---------------|---------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|--------------|--------------|--------------|--------------|--------------|--------------|--------------------|--------------|--------------------|--------------|--------------|------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|
| This PR                  |         1089 |                  1089 |          793 |                   793 |         3831 |              30351 |                   14442 |                   53846 |          376 |          510 |          217 |          435 |                322 |                482 |          254 |          298 |                                762 |                                807 |            673 |                        728 |                    776 |          726 |                      3247 |                      2247 |                       390 |                   408 |           308 |           416 |                     667 |                     361 |               2008 |               467 |               135 |              467 |                  710 |                974 |                  974 |            725 |              725 |               1413 |            446 |                       13604 |                       11932 |            227 |            246 |                                      1499 |                                      1185 |                                                         1455 |                                                      960 |                                             1462 |                                          967 |                                             1474 |                                          978 |                                                        978 |                                          1098 |                  3358 |                  3902 |                  1539 |                  1773 |         7695 |                  5886 |                  1613 |             5785 |             5420 |                    4275 |                    2979 |             1177 |             3894 |         2650 |         1143 |           2175 |           5263 |          1276 |         27511 |                     1276 |                     2533 |                927 |          858 |                       433874 |                         6292 |         23279 |         38224 |                11096 |                21520 |                   603 |                   990 |                   364 |                   558 |                   747 |                  1149 |                   436 |                   637 |            5391 |                                 5372 |                                 7802 |                   2059 |                   1450 |                  227 |              164 |                  227 |              164 |           2001 |           1388 |            2605 |             579 |            2770 |            2554 |                          2533 |         6048 |         1229 |                 1960 |             1907 |          315 |          881 |                   1090 |                    829 |         2144 |         2811 |         2797 |        32931 |          469 |          387 |                    1389 |                    1214 |                 495 |                1532 |                 312 |                 828 |                1026 |                1659 |                 555 |                 891 |                         556 |                         284 |                937 |                649 |                417 |                427 |                          1370 |                          1527 |             1370 |             1522 |                          2919 |                         11387 |                          9536 |                         11508 |                             14467 |                         11967 |                         8982 |                         7834 |                        11278 |                        11222 |        19133 |        16195 |         4149 |         1617 |               225 |                  528 |         1468 |         1260 |             1797 |             1269 |               5479 |           9495 |          5249 |          533 |          533 |          519 |          327 |                                  893 |                                  517 |            697 |                        752 |                    294 |          231 |          779 |          455 |          568 |         1684 |         2394 |                9208 |            9595 |                   7280 |                 17147 |                 14571 |                                40463 |                                 4312 |        34190 |        34196 |         4312 |                  4065 |                  2669 |              1224 |              1846 |              1231 |              2155 |             7193 |             9433 |            14509 |            19315 |                      13116 |                       7531 |                      13152 |                       7592 |                       7245 |                       3024 |                      13122 |                       7557 |                       7224 |                       3041 |                       7231 |                       3020 |                       6263 |                       2255 |                   188 |                   164 |             7193 |            18469 |             8797 |            19069 |                      35466 |                      17821 |                       8722 |                      35498 |                       8730 |                       8709 |                       1794 |                     11960 |                      7244 |                     11981 |                      7281 |                      7066 |                      2971 |                     11996 |                      7305 |                      7069 |                      2974 |                      7052 |                      2947 |                      6212 |                      2215 |            12209 |            12209 |            19670 |            11400 |         1421 |          781 |                 233 |          367 |         1092 |              3605 |              2380 |          374 |          374 |             1709 |             1709 |              329 |              206 |           658 |           759 |           2908 |           2969 |             2967 |                    1633 |                    1277 |                    1277 |           2627 |           1727 |             91 |            110 |         1078 |          210 |          416 |          122 |          3015 |              945 |         1545 |          426 |           6352 |           1583 |        29778 |         3794 |        19164 |        19164 |                207 |            207 |                                  762 |                                  807 |                         706 |                         754 |                                       754 |             651 |             704 |                           704 |                        1050 |                     300 |         1970 |         2578 |          339 |          407 |                           514 |                       867 |             4264 |             2595 |          1217 |           169 |           836 |           118 |         34469 |           303 |         30723 |           252 |                    1856 |                        2338 |                    1155 |                        1140 |                    1856 |                        1752 |                    1871 |                        1767 |                    1868 |                        1868 |                    2685 |                        3612 |                    1149 |                        1089 |                    2686 |                        2686 |                    2700 |                        2544 |                    2694 |                        2538 |         1217 |          849 |         3599 |         7530 |          826 |         2830 |              17918 |         1739 |               9697 |         2322 | -0.06%       |       0.61 | +0.00%      | +0.00%      | +0.00%      | +0.00%      | +0.00%      | +0.00%      | +0.00%      | +0.00%      | +0.00%      |
|--------------------------|--------------|-----------------------|--------------|-----------------------|--------------|--------------------|-------------------------|-------------------------|--------------|--------------|--------------|--------------|--------------------|--------------------|--------------|--------------|------------------------------------|------------------------------------|----------------|----------------------------|------------------------|--------------|---------------------------|---------------------------|---------------------------|-----------------------|---------------|---------------|-------------------------|-------------------------|--------------------|-------------------|-------------------|------------------|----------------------|--------------------|----------------------|----------------|------------------|--------------------|----------------|-----------------------------|-----------------------------|----------------|----------------|-------------------------------------------|-------------------------------------------|--------------------------------------------------------------|----------------------------------------------------------|--------------------------------------------------|----------------------------------------------|--------------------------------------------------|----------------------------------------------|------------------------------------------------------------|-----------------------------------------------|-----------------------|-----------------------|-----------------------|-----------------------|--------------|-----------------------|-----------------------|------------------|------------------|-------------------------|-------------------------|------------------|------------------|--------------|--------------|----------------|----------------|---------------|---------------|--------------------------|--------------------------|--------------------|--------------|------------------------------|------------------------------|---------------|---------------|----------------------|----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------|--------------------------------------|--------------------------------------|------------------------|------------------------|----------------------|------------------|----------------------|------------------|----------------|----------------|-----------------|-----------------|-----------------|-----------------|-------------------------------|--------------|--------------|----------------------|------------------|--------------|--------------|------------------------|------------------------|--------------|--------------|--------------|--------------|--------------|--------------|-------------------------|-------------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|-----------------------------|-----------------------------|--------------------|--------------------|--------------------|--------------------|-------------------------------|-------------------------------|------------------|------------------|-------------------------------|-------------------------------|-------------------------------|-------------------------------|-----------------------------------|-------------------------------|------------------------------|------------------------------|------------------------------|------------------------------|--------------|--------------|--------------|--------------|-------------------|----------------------|--------------|--------------|------------------|------------------|--------------------|----------------|---------------|--------------|--------------|--------------|--------------|--------------------------------------|--------------------------------------|----------------|----------------------------|------------------------|--------------|--------------|--------------|--------------|--------------|--------------|---------------------|-----------------|------------------------|-----------------------|-----------------------|--------------------------------------|--------------------------------------|--------------|--------------|--------------|-----------------------|-----------------------|-------------------|-------------------|-------------------|-------------------|------------------|------------------|------------------|------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|-----------------------|-----------------------|------------------|------------------|------------------|------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|------------------|------------------|------------------|------------------|--------------|--------------|---------------------|--------------|--------------|-------------------|-------------------|--------------|--------------|------------------|------------------|------------------|------------------|---------------|---------------|----------------|----------------|------------------|-------------------------|-------------------------|-------------------------|----------------|----------------|----------------|----------------|--------------|--------------|--------------|--------------|---------------|------------------|--------------|--------------|----------------|----------------|--------------|--------------|--------------|--------------|--------------------|----------------|--------------------------------------|--------------------------------------|-----------------------------|-----------------------------|-------------------------------------------|-----------------|-----------------|-------------------------------|-----------------------------|-------------------------|--------------|--------------|--------------|--------------|-------------------------------|---------------------------|------------------|------------------|---------------|---------------|---------------|---------------|---------------|---------------|---------------|---------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|--------------|--------------|--------------|--------------|--------------|--------------|--------------------|--------------|--------------------|--------------|--------------|------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|
| Total diff               | REGR(+1.97%) | REGR(+1.97%)          | REGR(+1.67%) | REGR(+1.67%)          | REGR(+0.24%) | REGR(+0.17%)       | SAME(+0.01%)            | SAME(+0.00%)            | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)       | SAME(+0.00%)       | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)                       | SAME(+0.00%)                       | SAME(+0.00%)   | SAME(+0.00%)               | SAME(+0.00%)           | SAME(+0.00%) | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)          | SAME(+0.00%)  | SAME(+0.00%)  | SAME(+0.00%)            | SAME(+0.00%)            | SAME(+0.00%)       | SAME(+0.00%)      | SAME(+0.00%)      | SAME(+0.00%)     | SAME(+0.00%)         | SAME(+0.00%)       | SAME(+0.00%)         | SAME(+0.00%)   | SAME(+0.00%)     | SAME(+0.00%)       | SAME(+0.00%)   | SAME(+0.00%)                | SAME(+0.00%)                | SAME(+0.00%)   | SAME(+0.00%)   | SAME(+0.00%)                              | SAME(+0.00%)                              | SAME(+0.00%)                                                 | SAME(+0.00%)                                             | SAME(+0.00%)                                     | SAME(+0.00%)                                 | SAME(+0.00%)                                     | SAME(+0.00%)                                 | SAME(+0.00%)                                               | SAME(+0.00%)                                  | SAME(+0.00%)          | SAME(+0.00%)          | SAME(+0.00%)          | SAME(+0.00%)          | SAME(+0.00%) | SAME(+0.00%)          | SAME(+0.00%)          | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)            | SAME(+0.00%)            | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)   | SAME(+0.00%)   | SAME(+0.00%)  | SAME(+0.00%)  | SAME(+0.00%)             | SAME(+0.00%)             | SAME(+0.00%)       | SAME(+0.00%) | SAME(+0.00%)                 | SAME(+0.00%)                 | SAME(+0.00%)  | SAME(+0.00%)  | SAME(+0.00%)         | SAME(+0.00%)         | SAME(+0.00%)          | SAME(+0.00%)          | SAME(+0.00%)          | SAME(+0.00%)          | SAME(+0.00%)          | SAME(+0.00%)          | SAME(+0.00%)          | SAME(+0.00%)          | SAME(+0.00%)    | SAME(+0.00%)                         | SAME(+0.00%)                         | SAME(+0.00%)           | SAME(+0.00%)           | SAME(+0.00%)         | SAME(+0.00%)     | SAME(+0.00%)         | SAME(+0.00%)     | SAME(+0.00%)   | SAME(+0.00%)   | SAME(+0.00%)    | SAME(+0.00%)    | SAME(+0.00%)    | SAME(+0.00%)    | SAME(+0.00%)                  | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)         | SAME(+0.00%)     | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)           | SAME(+0.00%)           | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)            | SAME(+0.00%)            | SAME(+0.00%)        | SAME(+0.00%)        | SAME(+0.00%)        | SAME(+0.00%)        | SAME(+0.00%)        | SAME(+0.00%)        | SAME(+0.00%)        | SAME(+0.00%)        | SAME(+0.00%)                | SAME(+0.00%)                | SAME(+0.00%)       | SAME(+0.00%)       | SAME(+0.00%)       | SAME(+0.00%)       | SAME(+0.00%)                  | SAME(+0.00%)                  | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)                  | SAME(+0.00%)                  | SAME(+0.00%)                  | SAME(+0.00%)                  | SAME(+0.00%)                      | SAME(+0.00%)                  | SAME(+0.00%)                 | SAME(+0.00%)                 | SAME(+0.00%)                 | SAME(+0.00%)                 | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)      | SAME(+0.00%)         | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)       | SAME(+0.00%)   | SAME(+0.00%)  | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)                         | SAME(+0.00%)                         | SAME(+0.00%)   | SAME(+0.00%)               | SAME(+0.00%)           | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)        | SAME(+0.00%)    | SAME(+0.00%)           | SAME(+0.00%)          | SAME(+0.00%)          | SAME(+0.00%)                         | SAME(+0.00%)                         | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)          | SAME(+0.00%)          | SAME(+0.00%)      | SAME(+0.00%)      | SAME(+0.00%)      | SAME(+0.00%)      | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)          | SAME(+0.00%)          | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)               | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)              | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)        | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)      | SAME(+0.00%)      | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)  | SAME(+0.00%)  | SAME(+0.00%)   | SAME(+0.00%)   | SAME(+0.00%)     | SAME(+0.00%)            | SAME(+0.00%)            | SAME(+0.00%)            | SAME(+0.00%)   | SAME(+0.00%)   | SAME(+0.00%)   | SAME(+0.00%)   | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)  | SAME(+0.00%)     | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)   | SAME(+0.00%)   | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)       | SAME(+0.00%)   | SAME(+0.00%)                         | SAME(+0.00%)                         | SAME(+0.00%)                | SAME(+0.00%)                | SAME(+0.00%)                              | SAME(+0.00%)    | SAME(+0.00%)    | SAME(+0.00%)                  | SAME(+0.00%)                | SAME(+0.00%)            | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%) | SAME(+0.00%)                  | SAME(+0.00%)              | SAME(+0.00%)     | SAME(+0.00%)     | SAME(+0.00%)  | SAME(+0.00%)  | SAME(+0.00%)  | SAME(+0.00%)  | SAME(+0.00%)  | SAME(+0.00%)  | SAME(+0.00%)  | SAME(+0.00%)  | SAME(+0.00%)            | SAME(+0.00%)                | SAME(+0.00%)            | SAME(+0.00%)                | SAME(+0.00%)            | SAME(+0.00%)                | SAME(+0.00%)            | SAME(+0.00%)                | SAME(+0.00%)            | SAME(+0.00%)                | SAME(+0.00%)            | SAME(+0.00%)                | SAME(+0.00%)            | SAME(+0.00%)                | SAME(+0.00%)            | SAME(+0.00%)                | SAME(+0.00%)            | SAME(+0.00%)                | SAME(+0.00%)            | SAME(+0.00%)                | SAME(+0.00%) | SAME(+0.00%) | IMPR(-0.64%) | IMPR(-1.81%) | IMPR(-3.17%) | IMPR(-3.77%) | IMPR(-4.31%)       | IMPR(-4.40%) | IMPR(-4.59%)       | IMPR(-5.22%) | -0.06%       |       0.61 | +0.00%      | +0.00%      | +0.00%      | +0.00%      | +0.00%      | +0.00%      | +0.00%      | +0.00%      | +0.00%      |
|--------------------------|--------------|-----------------------|--------------|-----------------------|--------------|--------------------|-------------------------|-------------------------|--------------|--------------|--------------|--------------|--------------------|--------------------|--------------|--------------|------------------------------------|------------------------------------|----------------|----------------------------|------------------------|--------------|---------------------------|---------------------------|---------------------------|-----------------------|---------------|---------------|-------------------------|-------------------------|--------------------|-------------------|-------------------|------------------|----------------------|--------------------|----------------------|----------------|------------------|--------------------|----------------|-----------------------------|-----------------------------|----------------|----------------|-------------------------------------------|-------------------------------------------|--------------------------------------------------------------|----------------------------------------------------------|--------------------------------------------------|----------------------------------------------|--------------------------------------------------|----------------------------------------------|------------------------------------------------------------|-----------------------------------------------|-----------------------|-----------------------|-----------------------|-----------------------|--------------|-----------------------|-----------------------|------------------|------------------|-------------------------|-------------------------|------------------|------------------|--------------|--------------|----------------|----------------|---------------|---------------|--------------------------|--------------------------|--------------------|--------------|------------------------------|------------------------------|---------------|---------------|----------------------|----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------------|-----------------|--------------------------------------|--------------------------------------|------------------------|------------------------|----------------------|------------------|----------------------|------------------|----------------|----------------|-----------------|-----------------|-----------------|-----------------|-------------------------------|--------------|--------------|----------------------|------------------|--------------|--------------|------------------------|------------------------|--------------|--------------|--------------|--------------|--------------|--------------|-------------------------|-------------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|---------------------|-----------------------------|-----------------------------|--------------------|--------------------|--------------------|--------------------|-------------------------------|-------------------------------|------------------|------------------|-------------------------------|-------------------------------|-------------------------------|-------------------------------|-----------------------------------|-------------------------------|------------------------------|------------------------------|------------------------------|------------------------------|--------------|--------------|--------------|--------------|-------------------|----------------------|--------------|--------------|------------------|------------------|--------------------|----------------|---------------|--------------|--------------|--------------|--------------|--------------------------------------|--------------------------------------|----------------|----------------------------|------------------------|--------------|--------------|--------------|--------------|--------------|--------------|---------------------|-----------------|------------------------|-----------------------|-----------------------|--------------------------------------|--------------------------------------|--------------|--------------|--------------|-----------------------|-----------------------|-------------------|-------------------|-------------------|-------------------|------------------|------------------|------------------|------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|-----------------------|-----------------------|------------------|------------------|------------------|------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|----------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|---------------------------|------------------|------------------|------------------|------------------|--------------|--------------|---------------------|--------------|--------------|-------------------|-------------------|--------------|--------------|------------------|------------------|------------------|------------------|---------------|---------------|----------------|----------------|------------------|-------------------------|-------------------------|-------------------------|----------------|----------------|----------------|----------------|--------------|--------------|--------------|--------------|---------------|------------------|--------------|--------------|----------------|----------------|--------------|--------------|--------------|--------------|--------------------|----------------|--------------------------------------|--------------------------------------|-----------------------------|-----------------------------|-------------------------------------------|-----------------|-----------------|-------------------------------|-----------------------------|-------------------------|--------------|--------------|--------------|--------------|-------------------------------|---------------------------|------------------|------------------|---------------|---------------|---------------|---------------|---------------|---------------|---------------|---------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|-------------------------|-----------------------------|--------------|--------------|--------------|--------------|--------------|--------------|--------------------|--------------|--------------------|--------------|--------------|------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|-------------|

The results quite modest at first glance, but the real goal of this PR is remove one PADD from GEMM in its innermost loop.

GEMM aie-public:

.LBB152_3:                              // %for.body353
                                        //   Parent Loop BB152_2 Depth=1
                                        // =>  This Inner Loop Header: Depth=2
	nopa	;		vldb	wh6, [p5, #96];		nopx	;		vmov	x4, x6
	vldb	wl6, [p5, #64];		mov	p5, p0;		vmac.f	bmh0, bmh0, x3, x4, r3
	vldb.3d	wh11, [p5], d0;		vshuffle	x4, x7, x7, r2
	mov	p0, p5;		vmac.f	bmh2, bmh2, x3, x4, r3
	vshuffle	x3, x9, x9, r2;		vmac.f	bmh1, bmh1, x1, x6, r3
	vlda	wh2, [p5, #32];		paddb	[p0], m4;		vshuffle	x7, x0, x0, r2;		vmac.f	bmh3, bmh3, x5, x4, r3
	vlda	wl2, [p5, #0];		paddb	[p0], #128;		vshuffle	x0, x2, x2, r2;		vmac.f	bml1, bml1, x5, x3, r3
	vldb	wl8, [p0], #32;		vmac.f	bmh7, bmh7, x5, x7, r3
	vldb	wh8, [p0], #32;		vmac.f	bml0, bml0, x5, x0, r3
	vldb	wl7, [p1], m5;		vmac.f	bmh4, bmh4, x10, x4, r3
	vldb	wl11, [p0], #32;		vmac.f	bmh8, bmh8, x10, x7, r3
	vldb	wh7, [p1], m6;		vshuffle	x1, x6, x11, r4;		vmac.f	bml3, bml3, x10, x0, r3
	vldb	wl9, [p1], m5;		vshuffle	x5, x6, x11, r16;		vmac.f	bml2, bml2, x10, x3, r3
	vldb	wh9, [p1], m6;		vmov	x6, x7;		vmac.f	bml4, bml4, x1, x0, r3
	vldb	wl0, [p1], m5;		vmov	x4, x3;		vmac.f	bmh5, bmh5, x1, x4, r3
	vldb	wh0, [p1], m6;		vmov	x3, x5;		vmac.f	bmh6, bmh6, x5, x4, r3
	vldb	wl2, [p1], m5;		vshuffle	x5, x2, x8, r4;		vmac.f	bml5, bml5, x5, x0, r3
.L_LEnd1:
	vldb.3d	wh2, [p1], d1;		nopa	;		nops	;		nopx	;		vshuffle	x10, x2, x8, r16;		vmac.f	bml6, bml6, x1, x4, r3

GEMM this PR:

.LBB152_3:                              // %for.body353
                                        //   Parent Loop BB152_2 Depth=1
                                        // =>  This Inner Loop Header: Depth=2
	nopa	;		vldb	wh8, [p5, #96];		nopx	;		vmov	x4, x8;		nops	
	vldb	wl8, [p5, #64];		mov	p5, p0;		vmac.f	bmh0, bmh0, x3, x4, r3
	vldb.3d	wh11, [p5], d0;		vshuffle	x4, x7, x7, r2
	mov	p0, p5;		vmac.f	bmh2, bmh2, x3, x4, r3
	vshuffle	x3, x9, x9, r2;		vmac.f	bmh1, bmh1, x1, x8, r3
	vldb	wl2, [p0], m4;		vshuffle	x7, x0, x0, r2;		vmac.f	bmh3, bmh3, x5, x4, r3
	vlda	wh2, [p5, #32];		paddb	[p0], #128;		vshuffle	x0, x2, x2, r2;		vmac.f	bml1, bml1, x5, x3, r3
	vldb	wl6, [p0], #32;		vmac.f	bmh7, bmh7, x5, x7, r3
	vldb	wh6, [p0], #32;		vmac.f	bml0, bml0, x5, x0, r3
	vldb	wl7, [p1], m5;		vmac.f	bmh4, bmh4, x10, x4, r3
	vldb	wl11, [p0], #32;		vmac.f	bmh8, bmh8, x10, x7, r3
	vldb	wh7, [p1], m6;		vshuffle	x1, x8, x11, r4;		vmac.f	bml3, bml3, x10, x0, r3
	vldb	wl9, [p1], m5;		vshuffle	x5, x8, x11, r16;		vmac.f	bml2, bml2, x10, x3, r3
	vldb	wh9, [p1], m6;		vmov	x8, x7;		vmac.f	bml4, bml4, x1, x0, r3
	vldb	wl0, [p1], m5;		vmov	x4, x3;		vmac.f	bmh5, bmh5, x1, x4, r3
	vldb	wh0, [p1], m6;		vmov	x3, x5;		vmac.f	bmh6, bmh6, x5, x4, r3
	vldb	wl2, [p1], m5;		vshuffle	x5, x2, x6, r4;		vmac.f	bml5, bml5, x5, x0, r3
.L_LEnd1:
	vldb.3d	wh2, [p1], d1;		nopa	;		nops	;		nopx	;		vshuffle	x10, x2, x6, r16;		vmac.f	bml6, bml6, x1, x4, r3

void llvm::applyUpdToConcat(MachineInstr &MI, MachineRegisterInfo &MRI,
MachineIRBuilder &B,
std::map<unsigned, Register> &IndexRegMap) {
B.setInstrAndDebugLoc(MI);
B.setDebugLoc(MI.getDebugLoc());
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why aren't the debug location and insertion point for MachineInstr the same?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @F-Stuckmann , in this case, the goal is to retain the same debug information (related to the instruction that we are replacing), but building the instruction in a different (shifted) position.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants