[PATCH] D56772: [MIR] Add simple PRE pass to MachineCSE

[Anton Afanasyev via Phabricator via llvm-commits]

anton-afanasyev added a comment.

Hi @hfinkel, 
Unfortunately, the results of **`compile_time`** are unstable and not reproducible. Below are two different runs.

The first run:

  > ~/llvm/test-suite/utils/compare.py  --filter-short -m compile_time ~/llvm/test-suite-results/results_rel_base.json ~/llvm/test-suite-results/results_rel_exp.json 
  Tests: 1163
  Short Running: 1010 (filtered out)
  Remaining: 153
  Metric: compile_time
  
  Program                                         results_rel_base  results_rel_exp diff 
                                                                                        
  MultiSourc...OE-ProxyApps-C/XSBench/XSBench     0.74              0.79            6.5%
  MicroBench...y/ReturnReference/retref-bench     1.24              1.17           -6.1%
  SingleSour...rks/Misc-C++/Large/sphereflake     0.71              0.68           -4.5%
  MultiSourc...ps-C++/HACCKernels/HACCKernels     0.72              0.76            4.4%
  MultiSourc...chmarks/Prolangs-C/gnugo/gnugo     1.40              1.34           -4.3%
  MultiSourc...rks/Prolangs-C++/employ/employ     0.76              0.73           -4.2%
  MicroBench...arks/ImageProcessing/Blur/blur     1.61              1.55           -4.0%
  MultiSourc...rks/Trimaran/enc-3des/enc-3des     0.62              0.65            3.8%
  MultiSourc...rks/mediabench/gsm/toast/toast     2.29              2.38            3.7%
  MultiSourc...Benchmarks/SciMark2-C/scimark2     0.79              0.82            3.6%
  MicroBench.../ImageProcessing/Dilate/Dilate     1.32              1.36            2.7%
  MicroBench...oopInterchange/LoopInterchange     0.74              0.72           -2.7%
  MultiSourc...s/Prolangs-C/unix-tbl/unix-tbl     2.22              2.16           -2.7%
  MultiSourc...rolangs-C/archie-client/archie     1.20              1.17           -2.7%
  MultiSourc...marks/Prolangs-C/loader/loader     0.62              0.60           -2.6%
         results_rel_base  results_rel_exp        diff
  count  153.000000        152.000000       152.000000
  mean   7.235216          7.270763        -0.000904  
  std    12.322023         12.328571        0.016021  
  min    0.600000          0.604000        -0.061093  
  25%    1.516000          1.535000        -0.007504  
  50%    3.784000          3.800000         0.000000  
  75%    5.568000          5.581000         0.006387  
  max    88.724000         88.972000        0.064516

and the second run:

  > ~/llvm/test-suite/utils/compare.py  --filter-short -m compile_time ~/llvm/test-suite-results/results_rel_base2.json ~/llvm/test-suite-results/results_rel_exp2.json 
  Tests: 1163
  Short Running: 1009 (filtered out)
  Remaining: 154
  Metric: compile_time
  
  Program                                         results_rel_base2  results_rel_exp2 diff 
                                                                                          
  ultiSource/Benchmarks/McCat/09-vor/vor          0.66               0.62            -6.6%
  ultiSource...Benchmarks/SciMark2-C/scimark2     0.80               0.75            -5.5%
  ultiSource...rolangs-C/archie-client/archie     1.16               1.22             5.2%
  ultiSource...OE-ProxyApps-C/XSBench/XSBench     0.79               0.76            -4.1%
  ultiSource/Benchmarks/McCat/18-imp/imp          0.80               0.83             4.0%
  ultiSource...OE-ProxyApps-C/RSBench/rsbench     0.87               0.90             3.7%
  ultiSource...rks/Trimaran/enc-3des/enc-3des     0.66               0.63            -3.7%
  ultiSource...hmarks/MallocBench/cfrac/cfrac     1.64               1.70             3.6%
  icroBenchm.../ImageProcessing/Dilate/Dilate     1.37               1.32            -3.5%
  ultiSource...ALAC/decode/alacconvert-decode     2.41               2.34            -3.0%
  ultiSource...chmarks/Prolangs-C++/city/city     3.22               3.13            -3.0%
  ultiSource...xyApps-C/Pathfinder/PathFinder     1.77               1.72            -2.9%
  ultiSource...s/Prolangs-C/compiler/compiler     0.86               0.84            -2.8%
  ultiSource...rks/Prolangs-C++/employ/employ     0.73               0.71            -2.7%
  ultiSource/Applications/sgefa/sgefa             0.99               1.02             2.4%
         results_rel_base2  results_rel_exp2        diff
  count  152.000000         153.000000        151.000000
  mean   7.284842           7.236418         -0.002551  
  std    12.346005          12.320806         0.015407  
  min    0.600000           0.604000         -0.066265  
  25%    1.567000           1.504000         -0.009324  
  50%    3.794000           3.776000         -0.001112  
  75%    5.609000           5.584000          0.005669  
  max    89.004000          89.036000         0.051724  


CHANGES SINCE LAST ACTION
  https://reviews.llvm.org/D56772/new/

https://reviews.llvm.org/D56772