[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Aug 16 10:36:40 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14481?compare_to=14477&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14481, Order: 188555, Start Time: 2013-08-16 15:45:44, End Time: 2013-08-16 17:38:41
      To: 14477, Order: 188551, Start Time: 2013-08-16 13:25:44, End Time: 2013-08-16 15:19:41
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 5 (39 on baseline)
Performance Improvements: 24 (46 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1078 (1022 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 47.26% (0.0893 => 0.1315, std.dev.: 0.0104)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 61.78% (0.0225 => 0.0364, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/salsa20: 8.36% (8.2799 => 8.9717, std.dev.: 0.0300)
  SingleSource/Benchmarks/Linpack/linpack-pc: 4.19% (50.2350 => 52.3389, std.dev.: 0.0185)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.66% (2.5955 => 2.6646, std.dev.: 0.0002)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -39.94% (0.0626 => 0.0376, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -33.25% (0.1257 => 0.0839, std.dev.: 0.0110)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -29.55% (0.0907 => 0.0639, std.dev.: 0.0099)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -25.41% (0.0488 => 0.0364, std.dev.: 0.0032)
  MultiSource/Benchmarks/Prolangs-C/football/football: -21.24% (1.3067 => 1.0292, std.dev.: 0.0812)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -21.09% (0.1190 => 0.0939, std.dev.: 0.0026)
  MultiSource/Applications/obsequi/Obsequi: -16.95% (1.4558 => 1.2090, std.dev.: 0.0179)
  SingleSource/Benchmarks/Misc/richards_benchmark: -12.42% (0.0934 => 0.0818, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc/oourafft: -10.90% (0.2678 => 0.2386, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout-C++/hash: -10.36% (0.5127 => 0.4596, std.dev.: 0.0192)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -8.15% (0.8874 => 0.8151, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -7.94% (0.3967 => 0.3652, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -7.81% (1.0953 => 1.0098, std.dev.: 0.0168)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.66% (0.3561 => 0.3324, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.46% (1.4294 => 1.3942, std.dev.: 0.0083)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -29.14% (6.6741 => 4.7294, std.dev.: 0.1105)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.33% (3.3686 => 3.2226, std.dev.: 0.0472)
  SingleSource/Benchmarks/Misc/richards_benchmark: -3.41% (1.3912 => 1.3438, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/flops-4: -1.93% (1.6705 => 1.6383, std.dev.: 0.0117)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.89% (3.3088 => 3.2464, std.dev.: 0.0040)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.46% (3.0533 => 3.0086, std.dev.: 0.0108)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -1.21% (1.4379 => 1.4205, std.dev.: 0.0053)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.21% (4.5231 => 4.4685, std.dev.: 0.0130)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.01% (2.5952 => 2.5690, std.dev.: 0.0093)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.06% (0.1356 => 0.1301, std.dev.: 0.0028)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 66.25% (0.0791 => 0.1315, std.dev.: 0.0104)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 45.73% (0.0844 => 0.1230, std.dev.: 0.0121)
  MultiSource/Benchmarks/FreeBench/distray/distray: 28.17% (0.1033 => 0.1324, std.dev.: 0.0025)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.27% (4.2444 => 4.5952, std.dev.: 0.1209)
  SingleSource/Benchmarks/Misc/oourafft: 4.47% (0.2284 => 0.2386, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 2.99% (0.3546 => 0.3652, std.dev.: 0.0009)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.39% (3.7285 => 6.2412, std.dev.: 0.1330)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 48.57% (0.0245 => 0.0364, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.56% (2.8867 => 4.2884, std.dev.: 0.0140)
  MultiSource/Benchmarks/FreeBench/neural/neural: 35.95% (0.3171 => 0.4311, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.07% (36.8900 => 46.8762, std.dev.: 2.0486)
  SingleSource/Benchmarks/Misc/pi: 25.81% (1.9835 => 2.4955, std.dev.: 0.0332)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 25.33% (0.0458 => 0.0574, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/hash: 18.01% (0.6295 => 0.7429, std.dev.: 0.0279)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.91% (14.9584 => 16.7392, std.dev.: 0.2044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 11.20% (0.2679 => 0.2979, std.dev.: 0.0075)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.13% (7.0762 => 7.8638, std.dev.: 0.1106)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.65% (0.1678 => 0.1840, std.dev.: 0.0007)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.53% (1.2557 => 1.3628, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.32% (5.4910 => 5.9479, std.dev.: 0.0238)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.30% (48.3256 => 52.3389, std.dev.: 0.0185)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 8.06% (0.1365 => 0.1475, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 7.56% (2.9962 => 3.2226, std.dev.: 0.0472)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.92% (3.2027 => 3.4243, std.dev.: 0.0415)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.62% (2.9568 => 3.1525, std.dev.: 0.0532)
  MultiSource/Applications/siod/siod: 6.62% (3.3761 => 3.5995, std.dev.: 0.0427)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.30% (3.4085 => 3.6232, std.dev.: 0.0229)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.24% (5.3042 => 5.6350, std.dev.: 0.0360)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.48% (5.5008 => 5.8023, std.dev.: 0.1072)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.31% (4.0075 => 4.2204, std.dev.: 0.0354)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.67% (5.1471 => 5.3876, std.dev.: 0.0597)
  SingleSource/Benchmarks/Misc/whetstone: 4.45% (3.4559 => 3.6096, std.dev.: 0.0302)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.3151 => 4.4960, std.dev.: 0.0080)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.61% (6.1245 => 6.3458, std.dev.: 0.0432)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.51% (3.3877 => 3.5067, std.dev.: 0.0139)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.25% (25.0200 => 25.8332, std.dev.: 0.0663)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.92% (4.8739 => 5.0162, std.dev.: 0.0340)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.28% (12.8625 => 13.1564, std.dev.: 0.0385)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.83% (3.3464 => 3.4075, std.dev.: 0.0022)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -30.98% (0.2237 => 0.1544, std.dev.: 0.0131)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.29% (0.1072 => 0.0758, std.dev.: 0.0088)
  MultiSource/Benchmarks/MallocBench/gs/gs: -20.81% (6.0938 => 4.8259, std.dev.: 0.1798)
  MultiSource/Benchmarks/Olden/tsp/tsp: -20.19% (0.1818 => 0.1451, std.dev.: 0.0140)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -19.65% (1.5228 => 1.2235, std.dev.: 0.0654)
  MultiSource/Applications/obsequi/Obsequi: -17.67% (1.4685 => 1.2090, std.dev.: 0.0179)
  MultiSource/Applications/lua/lua: -17.05% (5.3200 => 4.4128, std.dev.: 0.2943)
  MultiSource/Applications/hbd/hbd: -16.41% (2.0193 => 1.6880, std.dev.: 0.1230)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -16.15% (0.0675 => 0.0566, std.dev.: 0.0023)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -16.14% (0.3576 => 0.2999, std.dev.: 0.0178)
  MultiSource/Applications/hexxagon/hexxagon: -15.36% (1.3285 => 1.1244, std.dev.: 0.0527)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.18% (1.5426 => 1.4318, std.dev.: 0.0232)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.16% (1.5345 => 1.4246, std.dev.: 0.0412)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.14% (1.5144 => 1.4063, std.dev.: 0.0219)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.52% (1.4794 => 1.3829, std.dev.: 0.0185)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.31% (1.6226 => 1.5202, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.92% (1.5815 => 1.4879, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.91% (1.4333 => 1.3486, std.dev.: 0.0257)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.66% (1.5437 => 1.4563, std.dev.: 0.0200)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.33% (1.4940 => 1.4143, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.98% (1.4783 => 1.4047, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.97% (1.4339 => 1.3627, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.87% (1.4506 => 1.3799, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.67% (1.4179 => 1.3942, std.dev.: 0.0083)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -34.48% (0.1189 => 0.0779, std.dev.: 0.0039)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.43% (2.1022 => 1.4205, std.dev.: 0.0053)
  MultiSource/Applications/viterbi/viterbi: -27.25% (3.4923 => 2.5408, std.dev.: 0.3091)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.58% (6.9552 => 5.2455, std.dev.: 0.0022)
  MultiSource/Applications/JM/ldecod/ldecod: -24.45% (0.0859 => 0.0649, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/perlin: -21.44% (4.5989 => 3.6131, std.dev.: 0.0036)
  MultiSource/Applications/obsequi/Obsequi: -18.70% (2.6081 => 2.1203, std.dev.: 0.1889)
  SingleSource/Benchmarks/Misc/mandel: -13.88% (1.1996 => 1.0331, std.dev.: 0.0022)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.47% (3.5791 => 3.3474, std.dev.: 0.0652)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.34% (1.7207 => 1.6289, std.dev.: 0.0339)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.30% (0.7355 => 0.7039, std.dev.: 0.0065)
  SingleSource/Benchmarks/Misc/fbench: -4.25% (4.9602 => 4.7492, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.74% (1.1024 => 1.0612, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.32% (6.0444 => 5.8435, std.dev.: 0.0520)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.18% (5.2218 => 5.0555, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.99% (6.1482 => 5.9645, std.dev.: 0.0298)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.54% (21.6864 => 21.1352, std.dev.: 0.1644)
  SingleSource/Benchmarks/Misc/oourafft: -2.09% (3.7891 => 3.7098, std.dev.: 0.0017)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.03% (34.8438 => 34.1379, std.dev.: 0.1663)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.49% (2.7049 => 2.6646, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.45% (5.8810 => 5.7960, std.dev.: 0.0276)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.39% (4.9231 => 4.8547, std.dev.: 0.0208)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.59% (0.1378 => 0.1301, std.dev.: 0.0028)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130816/51f273ef/attachment.html>


More information about the llvm-testresults mailing list