[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Dec 18 22:08:38 PST 2013


http://llvm.org/perf/db_default/v4/nts/18613?compare_to=18608&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18613, Order: 197654, Start Time: 2013-12-19 04:27:55, End Time: 2013-12-19 06:13:00
      To: 18608, Order: 197640, Start Time: 2013-12-19 02:11:09, End Time: 2013-12-19 04:01:30
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 12 (22 on baseline)
Performance Improvements: 49 (17 on baseline)
Unchanged Tests: 1049 (1071 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Puzzle: 13.27% (0.1598 => 0.1810, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.67% (3.5843 => 3.8591, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.26% (3.5010 => 3.7203, std.dev.: 0.0025)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 6.24% (1.1256 => 1.1958, std.dev.: 0.0023)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.98% (0.4394 => 0.4613, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout/sieve: 4.76% (6.7504 => 7.0715, std.dev.: 0.0803)
  MultiSource/Benchmarks/sim/sim: 4.36% (3.8137 => 3.9800, std.dev.: 0.0189)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.01% (5.0471 => 5.2496, std.dev.: 0.0101)
  MultiSource/Applications/sgefa/sgefa: 2.48% (0.8854 => 0.9074, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.94% (5.3019 => 5.4048, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.60% (5.9984 => 6.0943, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.34% (5.5180 => 5.5917, std.dev.: 0.0051)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -25.21% (0.2658 => 0.1988, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -24.94% (0.0441 => 0.0331, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C++/family/family: -24.51% (0.0559 => 0.0422, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -14.09% (0.2285 => 0.1963, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -13.02% (0.3233 => 0.2812, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: -12.89% (0.1164 => 0.1014, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.47% (0.0866 => 0.0758, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/sieve: -11.30% (0.3213 => 0.2850, std.dev.: 0.0054)
  MultiSource/Applications/JM/lencod/lencod: -10.80% (19.3779 => 17.2851, std.dev.: 0.2157)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -10.63% (1.5291 => 1.3666, std.dev.: 0.0430)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -10.39% (0.1059 => 0.0949, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/strcat: -9.26% (0.2278 => 0.2067, std.dev.: 0.0045)
  MultiSource/Benchmarks/Olden/tsp/tsp: -8.89% (0.1451 => 0.1322, std.dev.: 0.0015)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.30% (0.2842 => 0.2606, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/power/power: -7.46% (0.1501 => 0.1389, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -7.33% (1.5699 => 1.4548, std.dev.: 0.0397)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -7.26% (0.2301 => 0.2134, std.dev.: 0.0058)
  MultiSource/Applications/spiff/spiff: -6.93% (0.9708 => 0.9035, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.64% (1.3426 => 1.2534, std.dev.: 0.0174)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.63% (1.8062 => 1.7045, std.dev.: 0.0285)
  SingleSource/Benchmarks/Shootout-C++/ary2: -5.42% (0.2730 => 0.2582, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -5.40% (0.2221 => 0.2101, std.dev.: 0.0016)
  MultiSource/Applications/hbd/hbd: -5.29% (1.6326 => 1.5463, std.dev.: 0.0161)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -5.21% (0.2265 => 0.2147, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.18% (5.6850 => 5.3904, std.dev.: 0.1139)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.11% (0.6777 => 0.6431, std.dev.: 0.0088)
  MultiSource/Applications/treecc/treecc: -5.08% (2.3883 => 2.2669, std.dev.: 0.0440)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.81% (0.4015 => 0.3822, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.59% (1.3758 => 1.3126, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.49% (1.3039 => 1.2453, std.dev.: 0.0092)
  SingleSource/Benchmarks/Shootout-C++/matrix: -4.43% (0.2505 => 0.2394, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.38% (0.3585 => 0.3428, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/hash: -4.25% (0.4144 => 0.3968, std.dev.: 0.0016)
  MultiSource/Applications/hexxagon/hexxagon: -4.20% (1.0892 => 1.0435, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.41% (1.3207 => 1.2756, std.dev.: 0.0123)
  SingleSource/Benchmarks/Shootout-C++/moments: -3.39% (0.3977 => 0.3842, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.28% (1.2713 => 1.2296, std.dev.: 0.0138)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -2.80% (0.3683 => 0.3580, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc-C++/bigfib: -1.74% (0.6783 => 0.6665, std.dev.: 0.0035)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary: -24.02% (0.0537 => 0.0408, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -20.46% (0.1745 => 0.1388, std.dev.: 0.0108)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -17.23% (0.9248 => 0.7655, std.dev.: 0.0314)
  MultiSource/Applications/lemon/lemon: -10.00% (0.9143 => 0.8229, std.dev.: 0.0338)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.94% (0.3714 => 0.3345, std.dev.: 0.0137)
  MultiSource/Applications/ClamAV/clamscan: -9.69% (0.1465 => 0.1323, std.dev.: 0.0021)
  MultiSource/Benchmarks/Olden/bisort/bisort: -6.84% (0.7207 => 0.6714, std.dev.: 0.0100)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -5.14% (2.6650 => 2.5280, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.81% (5.8687 => 5.7038, std.dev.: 0.0077)
  MultiSource/Benchmarks/Olden/bh/bh: -1.73% (2.4304 => 2.3884, std.dev.: 0.0081)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 38.96% (15.7419 => 21.8755, std.dev.: 0.5325)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 27.16% (0.3859 => 0.4907, std.dev.: 0.0121)
  MultiSource/Applications/lemon/lemon: 9.20% (1.2200 => 1.3322, std.dev.: 0.0151)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.95% (0.6412 => 0.6665, std.dev.: 0.0035)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.52% (1.1019 => 1.1958, std.dev.: 0.0023)
  SingleSource/Benchmarks/Stanford/Puzzle: 8.51% (0.1668 => 0.1810, std.dev.: 0.0021)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 8.06% (0.3534 => 0.3819, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.88% (3.5771 => 3.8591, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.21% (3.5027 => 3.7203, std.dev.: 0.0025)
  MultiSource/Applications/siod/siod: 5.11% (3.4258 => 3.6010, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout/sieve: 4.83% (6.7454 => 7.0715, std.dev.: 0.0803)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.42% (3.4043 => 3.5549, std.dev.: 0.0346)
  MultiSource/Applications/sgefa/sgefa: 3.76% (0.8745 => 0.9074, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.74% (5.0601 => 5.2496, std.dev.: 0.0101)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.12% (15.5356 => 16.0206, std.dev.: 0.1726)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.07% (5.9126 => 6.0943, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.07% (11.7894 => 12.0333, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.04% (5.2486 => 5.3555, std.dev.: 0.0393)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.47% (1.5797 => 1.6030, std.dev.: 0.0056)
  MultiSource/Benchmarks/llubenchmark/llu: 1.41% (1.9763 => 2.0041, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.09% (5.3463 => 5.4048, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.07% (4.9365 => 4.9895, std.dev.: 0.0040)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.89% (0.0688 => 0.0503, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.11% (0.1088 => 0.0978, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.25% (5.8749 => 5.3904, std.dev.: 0.1139)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.72% (0.2824 => 0.2606, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.84% (0.6882 => 0.6411, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.27% (1.3676 => 1.2819, std.dev.: 0.0234)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.66% (1.3146 => 1.2534, std.dev.: 0.0174)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.64% (1.3505 => 1.2878, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.33% (1.3127 => 1.2558, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.24% (1.2583 => 1.2050, std.dev.: 0.0206)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.99% (1.5305 => 1.4695, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.93% (1.2914 => 1.2407, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.91% (1.3660 => 1.3126, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.96% (1.3460 => 1.3061, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.95% (1.2544 => 1.2174, std.dev.: 0.0112)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -10.11% (23.4696 => 21.0974, std.dev.: 0.6901)
  MultiSource/Applications/sqlite3/sqlite3: -4.08% (4.2978 => 4.1224, std.dev.: 0.0482)

Report Time: 0.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131219/956cae78/attachment.html>


More information about the llvm-testresults mailing list