<div dir="ltr">This looks super noisy even at 5 runs :)<div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Jun 15, 2016 at 12:35 PM, Geoff Berry <span dir="ltr"><<a href="mailto:gberry@codeaurora.org" target="_blank">gberry@codeaurora.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">gberry added a comment.<br>
<br>
Here are the worst llvm test-suite compile time regressions.  I've filtered out the very small test cases.  The data shown are the percent diffs of compile times from 5 different runs with and without the above change.<br>
<br>
llvm-test-suite/SingleSource/Benchmarks/Misc/ffbench:normal                                              PASS      +1.079%, +2.837%, +17.951%, +21.615%, +33.206%<br>
llvm-test-suite/SingleSource/Benchmarks/Shootout-C++/shootout-cxx-moments:normal                         PASS      +1.148%, +9.801%, +14.607%, +15.686%, +19.707%<br>
llvm-test-suite/MultiSource/Applications/spiff/spiff:normal                                              PASS      -0.773%, +2.938%, +13.511%, +16.846%, +21.552%<br>
llvm-test-suite/SingleSource/Benchmarks/Shootout-C++/shootout-cxx-nestedloop:normal                      PASS      -1.623%, +1.635%, +12.996%, +13.561%, +14.354%<br>
llvm-test-suite/MultiSource/Benchmarks/Prolangs-C++/garage/garage:normal                                 PASS      +1.092%, +8.865%, +12.830%, +14.206%, +15.722%<br>
llvm-test-suite/MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl:normal         PASS      +4.676%, +5.196%, +10.725%, +12.248%, +12.967%<br>
llvm-test-suite/MultiSource/Benchmarks/MallocBench/espresso/espresso:normal                              PASS      -2.227%, +4.387%, +9.187%, +11.195%, +13.738%<br>
llvm-test-suite/MultiSource/Benchmarks/BitBench/uuencode/uuencode:normal                                 PASS      -0.223%, +3.068%, +7.235%, +9.723%, +18.255%<br>
llvm-test-suite/SingleSource/Benchmarks/Misc-C++/stepanov_container:normal                               PASS      +1.185%, +2.054%, +4.369%, +8.627%, +11.474%<br>
llvm-test-suite/MultiSource/Benchmarks/Prolangs-C++/family/family:normal                                 PASS      +1.386%, +1.767%, +4.300%, +10.017%, +19.309%<br>
llvm-test-suite/MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio:normal                       PASS      +1.995%, +2.907%, +3.697%, +12.124%, +12.976%<br>
llvm-test-suite/SingleSource/Benchmarks/Dhrystone/fldry:normal                                           PASS      +1.920%, +2.027%, +2.843%, +14.746%, +14.803%<br>
llvm-test-suite/MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4:normal                                      PASS      +1.305%, +1.674%, +2.269%, +2.961%, +9.660%<br>
<br>
<br>
<a href="http://reviews.llvm.org/D19821" rel="noreferrer" target="_blank">http://reviews.llvm.org/D19821</a><br>
<br>
<br>
<br>
</blockquote></div><br></div>