[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 2 20:03:05 PST 2013


http://llvm.org/perf/db_default/v4/nts/17856?compare_to=17849&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17856, Order: 196194, Start Time: 2013-12-03 02:23:18, End Time: 2013-12-03 04:07:10
      To: 17849, Order: 196169, Start Time: 2013-12-03 00:07:22, End Time: 2013-12-03 01:56:48
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 28 (24 on baseline)
Performance Improvements: 67 (20 on baseline)
Unchanged Tests: 1015 (1066 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/nbench/nbench: 7.62% (1.3045 => 1.4039, std.dev.: 0.0061)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 80.90% (0.0199 => 0.0360, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout/matrix: 13.94% (1.8498 => 2.1077, std.dev.: 0.0019)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.80% (2.5665 => 2.8437, std.dev.: 0.0546)
  SingleSource/Benchmarks/Stanford/Puzzle: 9.07% (0.1686 => 0.1839, std.dev.: 0.0007)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.12% (0.3537 => 0.3789, std.dev.: 0.0016)
  SingleSource/Benchmarks/McGill/misr: 6.51% (0.3827 => 0.4076, std.dev.: 0.0032)
  SingleSource/Benchmarks/Stanford/FloatMM: 6.48% (0.6848 => 0.7292, std.dev.: 0.0000)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.21% (3.5869 => 3.8096, std.dev.: 0.0317)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 5.40% (0.3724 => 0.3925, std.dev.: 0.0034)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.16% (1.1049 => 1.1619, std.dev.: 0.0146)
  MultiSource/Applications/aha/aha: 4.56% (3.5861 => 3.7496, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.76% (5.0597 => 5.2501, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout/lists: 3.27% (7.1257 => 7.3588, std.dev.: 0.0747)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 3.09% (0.4784 => 0.4932, std.dev.: 0.0021)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.02% (3.7302 => 3.8429, std.dev.: 0.0019)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.78% (5.4606 => 5.6126, std.dev.: 0.0344)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.72% (1.2468 => 1.2807, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.62% (6.5240 => 6.6949, std.dev.: 0.0085)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.39% (3.5785 => 3.6642, std.dev.: 0.0014)
  MultiSource/Applications/lambda-0_1_3/lambda: 2.23% (7.8176 => 7.9918, std.dev.: 0.0021)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.11% (0.6392 => 0.6527, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.03% (3.1505 => 3.2146, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout/fib2: 1.78% (3.5861 => 3.6499, std.dev.: 0.0142)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.55% (3.8081 => 3.8672, std.dev.: 0.0190)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.55% (3.1385 => 3.1872, std.dev.: 0.0058)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.19% (8.7913 => 8.8957, std.dev.: 0.0173)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.16% (1.6155 => 1.6342, std.dev.: 0.0022)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: -44.97% (0.0298 => 0.0164, std.dev.: 0.0000)
  SingleSource/UnitTests/2003-09-18-BitFieldTest: -44.64% (0.0280 => 0.0155, std.dev.: 0.0005)
  SingleSource/UnitTests/2007-03-02-VaCopy: -43.42% (0.0281 => 0.0159, std.dev.: 0.0001)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: -43.01% (0.0372 => 0.0212, std.dev.: 0.0009)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: -42.82% (0.0411 => 0.0235, std.dev.: 0.0001)
  SingleSource/UnitTests/2005-05-12-Int64ToFP: -42.55% (0.0282 => 0.0162, std.dev.: 0.0001)
  SingleSource/Benchmarks/Stanford/FloatMM: -42.28% (0.0764 => 0.0441, std.dev.: 0.0005)
  SingleSource/UnitTests/2003-05-12-MinIntProblem: -41.73% (0.0266 => 0.0155, std.dev.: 0.0001)
  SingleSource/UnitTests/2003-08-11-VaListArg: -41.52% (0.0501 => 0.0293, std.dev.: 0.0007)
  SingleSource/Benchmarks/Stanford/Towers: -41.47% (0.0868 => 0.0508, std.dev.: 0.0007)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: -38.98% (0.0372 => 0.0227, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: -37.85% (0.0428 => 0.0266, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout/random: -36.49% (0.0518 => 0.0329, std.dev.: 0.0001)
  SingleSource/UnitTests/2003-08-05-CastFPToUint: -35.38% (0.0325 => 0.0210, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: -34.40% (0.1526 => 0.1001, std.dev.: 0.0117)
  SingleSource/UnitTests/2003-05-26-Shorts: -34.23% (0.0336 => 0.0221, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -34.00% (0.1253 => 0.0827, std.dev.: 0.0015)
  SingleSource/UnitTests/2003-05-31-CastToBool: -29.16% (0.0367 => 0.0260, std.dev.: 0.0007)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -23.38% (0.9456 => 0.7245, std.dev.: 0.0728)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -21.49% (0.0861 => 0.0676, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -21.02% (0.1194 => 0.0943, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -20.37% (0.0761 => 0.0606, std.dev.: 0.0051)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -20.04% (0.0923 => 0.0738, std.dev.: 0.0014)
  MultiSource/Applications/lua/lua: -12.83% (4.9152 => 4.2848, std.dev.: 0.0367)
  MultiSource/Applications/ClamAV/clamscan: -12.71% (19.2556 => 16.8078, std.dev.: 0.2751)
  MultiSource/Applications/hbd/hbd: -12.66% (1.7902 => 1.5635, std.dev.: 0.0287)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.77% (10.8840 => 9.8204, std.dev.: 0.1627)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -8.69% (0.6816 => 0.6224, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -8.56% (1.4420 => 1.3186, std.dev.: 0.0292)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -8.32% (1.4109 => 1.2935, std.dev.: 0.0113)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.81% (1.6305 => 1.5195, std.dev.: 0.0304)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -6.50% (1.2400 => 1.1594, std.dev.: 0.0138)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -6.31% (0.2061 => 0.1931, std.dev.: 0.0006)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.26% (2.1050 => 1.9733, std.dev.: 0.0364)
  SingleSource/Benchmarks/Shootout-C++/random: -6.09% (0.2168 => 0.2036, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.58% (1.3663 => 1.2900, std.dev.: 0.0067)
  MultiSource/Applications/lambda-0_1_3/lambda: -5.42% (0.8667 => 0.8197, std.dev.: 0.0172)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -5.29% (0.2249 => 0.2130, std.dev.: 0.0029)
  MultiSource/Benchmarks/McCat/08-main/main: -4.92% (0.3128 => 0.2974, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.92% (1.2839 => 1.2207, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.88% (1.4053 => 1.3367, std.dev.: 0.0068)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.25% (1.2084 => 1.1570, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.12% (1.4089 => 1.3509, std.dev.: 0.0162)
  MultiSource/Applications/lemon/lemon: -4.00% (1.2702 => 1.2194, std.dev.: 0.0073)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.94% (0.3094 => 0.2972, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/oourafft: -3.86% (0.2594 => 0.2494, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.68% (1.2998 => 1.2650, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -2.66% (1.2930 => 1.2586, std.dev.: 0.0105)
  SingleSource/Benchmarks/Misc-C++/bigfib: -2.00% (0.6598 => 0.6466, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.67% (0.9007 => 0.8857, std.dev.: 0.0046)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: -36.53% (4.5069 => 2.8607, std.dev.: 0.0424)
  MultiSource/Benchmarks/Olden/bisort/bisort: -18.93% (0.8345 => 0.6765, std.dev.: 0.0552)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -16.72% (3.3975 => 2.8296, std.dev.: 0.0559)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -15.19% (4.3838 => 3.7179, std.dev.: 0.0783)
  MultiSource/Applications/lemon/lemon: -15.05% (0.9965 => 0.8465, std.dev.: 0.0306)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -13.33% (0.1665 => 0.1443, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/ary3: -13.30% (5.1361 => 4.4529, std.dev.: 0.1634)
  SingleSource/Benchmarks/Shootout/ary3: -8.75% (5.0241 => 4.5846, std.dev.: 0.0839)
  SingleSource/Benchmarks/Shootout/hash: -6.60% (5.4636 => 5.1032, std.dev.: 0.0356)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.42% (7.2009 => 6.8105, std.dev.: 0.0429)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -4.65% (0.2752 => 0.2624, std.dev.: 0.0005)
  SingleSource/Benchmarks/Dhrystone/dry: -4.05% (0.5038 => 0.4834, std.dev.: 0.0016)
  SingleSource/Regression/C/uint64_to_float: -3.67% (1.5140 => 1.4584, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/methcall: -2.32% (7.8896 => 7.7069, std.dev.: 0.0111)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.25% (0.7598 => 0.7427, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.89% (3.6559 => 3.5867, std.dev.: 0.0039)
  SingleSource/Benchmarks/McGill/chomp: -1.34% (1.0266 => 1.0128, std.dev.: 0.0038)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/nbench/nbench: 11.01% (1.2647 => 1.4039, std.dev.: 0.0061)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: 17.36% (1.7960 => 2.1077, std.dev.: 0.0019)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.26% (2.5559 => 2.8437, std.dev.: 0.0546)
  SingleSource/Benchmarks/Stanford/Puzzle: 10.25% (0.1668 => 0.1839, std.dev.: 0.0007)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.22% (0.3534 => 0.3789, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.50% (3.5771 => 3.8096, std.dev.: 0.0317)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.45% (1.1019 => 1.1619, std.dev.: 0.0146)
  SingleSource/Benchmarks/Shootout/lists: 5.23% (6.9930 => 7.3588, std.dev.: 0.0747)
  MultiSource/Applications/aha/aha: 5.19% (3.5645 => 3.7496, std.dev.: 0.0127)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.09% (0.6939 => 0.7292, std.dev.: 0.0000)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.31% (1.2278 => 1.2807, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.75% (5.0601 => 5.2501, std.dev.: 0.0058)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.99% (3.7315 => 3.8429, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.54% (6.5291 => 6.6949, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (5.9133 => 6.0536, std.dev.: 0.0430)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.23% (1.5986 => 1.6342, std.dev.: 0.0022)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.18% (0.6388 => 0.6527, std.dev.: 0.0039)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.06% (5.4994 => 5.6126, std.dev.: 0.0344)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.99% (5.9126 => 6.0305, std.dev.: 0.0297)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.90% (3.1547 => 3.2146, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout/fib2: 1.50% (3.5960 => 3.6499, std.dev.: 0.0142)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.33% (3.1455 => 3.1872, std.dev.: 0.0058)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.24% (5.9583 => 6.0320, std.dev.: 0.0096)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.00% (8.8073 => 8.8957, std.dev.: 0.0173)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: -9.43% (36.6274 => 33.1723, std.dev.: 1.0948)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.77% (0.6882 => 0.6416, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.19% (1.4113 => 1.3239, std.dev.: 0.0196)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.1774 => 0.1671, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.43% (1.4277 => 1.3502, std.dev.: 0.0161)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.40% (1.1409 => 1.0793, std.dev.: 0.0207)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.36% (1.3676 => 1.2943, std.dev.: 0.0165)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.21% (1.3505 => 1.2801, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.63% (1.3264 => 1.2650, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.36% (1.4125 => 1.3509, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.16% (1.3460 => 1.2900, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.12% (1.3127 => 1.2586, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.96% (1.3918 => 1.3367, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.84% (1.2824 => 1.2331, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.99% (1.2583 => 1.2207, std.dev.: 0.0120)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: -5.51% (2.9945 => 2.8296, std.dev.: 0.0559)
  MultiSource/Benchmarks/Bullet/bullet: -5.50% (7.4226 => 7.0140, std.dev.: 0.1553)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.68% (6.0535 => 5.8912, std.dev.: 0.0091)
  MultiSource/Applications/lua/lua: -2.24% (29.1357 => 28.4838, std.dev.: 0.2117)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.96% (3.6583 => 3.5867, std.dev.: 0.0039)

Report Time: 1.00s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131202/2c86139d/attachment.html>


More information about the llvm-testresults mailing list