[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Dec 4 04:49:54 PST 2013


http://llvm.org/perf/db_default/v4/nts/17947?compare_to=17943&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17947, Order: 196372, Start Time: 2013-12-04 11:10:53, End Time: 2013-12-04 12:54:02
      To: 17943, Order: 196362, Start Time: 2013-12-04 08:54:24, End Time: 2013-12-04 10:41:45
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 20 (21 on baseline)
Performance Improvements: 46 (17 on baseline)
Unchanged Tests: 1044 (1072 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 52.72% (1.7091 => 2.6102, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout/matrix: 16.34% (1.8124 => 2.1085, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/ReedSolomon: 14.42% (8.5412 => 9.7730, std.dev.: 0.0040)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 8.32% (0.4817 => 0.5218, std.dev.: 0.0003)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.03% (5.3943 => 5.6659, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout/ary3: 4.67% (4.4221 => 4.6285, std.dev.: 0.0125)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.50% (0.6954 => 0.7267, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/fp-convert: 4.50% (7.4444 => 7.7791, std.dev.: 0.0393)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.24% (1.2525 => 1.3056, std.dev.: 0.0198)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.94% (0.3836 => 0.3987, std.dev.: 0.0013)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.89% (15.5541 => 16.1591, std.dev.: 0.1165)
  SingleSource/Benchmarks/Shootout/lists: 3.87% (7.1494 => 7.4258, std.dev.: 0.0555)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 3.62% (0.4805 => 0.4979, std.dev.: 0.0023)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.52% (4.1927 => 4.3401, std.dev.: 0.0302)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.32% (6.5570 => 6.7092, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.20% (3.1520 => 3.2212, std.dev.: 0.0025)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.09% (1.7233 => 1.7594, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.02% (5.5022 => 5.6135, std.dev.: 0.0057)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.51% (7.8310 => 7.9494, std.dev.: 0.0307)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.02% (6.7738 => 6.8426, std.dev.: 0.0003)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/compare: -38.42% (0.0367 => 0.0226)
  SingleSource/Regression/C/PR10189: -36.55% (0.0394 => 0.0250, std.dev.: 0.0006)
  SingleSource/UnitTests/2003-07-06-IntOverflow: -35.09% (0.0322 => 0.0209, std.dev.: 0.0001)
  SingleSource/UnitTests/2003-05-07-VarArgs: -33.93% (0.0389 => 0.0257, std.dev.: 0.0023)
  SingleSource/Regression/C++/EH/recursive-throw: -30.52% (0.0367 => 0.0255, std.dev.: 0.0001)
  SingleSource/UnitTests/SignlessTypes/div: -30.32% (0.0498 => 0.0347, std.dev.: 0.0004)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -23.24% (0.7492 => 0.5751, std.dev.: 0.0467)
  SingleSource/Benchmarks/Linpack/linpack-pc: -13.92% (0.3627 => 0.3122, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/bisort/bisort: -12.33% (0.0811 => 0.0711, std.dev.: 0.0037)
  MultiSource/Applications/aha/aha: -10.65% (0.1390 => 0.1242, std.dev.: 0.0015)
  SingleSource/Benchmarks/SmallPT/smallpt: -7.77% (0.1531 => 0.1412, std.dev.: 0.0012)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.03% (1.6216 => 1.5238, std.dev.: 0.0093)
  MultiSource/Applications/SPASS/SPASS: -5.88% (17.4813 => 16.4537, std.dev.: 0.1622)
  SingleSource/Benchmarks/Shootout-C++/hash2: -5.80% (0.4517 => 0.4255, std.dev.: 0.0017)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.73% (4.4611 => 4.2053, std.dev.: 0.0323)
  SingleSource/Benchmarks/Shootout-C++/ary: -5.31% (0.2582 => 0.2445, std.dev.: 0.0023)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -5.18% (0.4128 => 0.3914, std.dev.: 0.0033)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.50% (2.0648 => 1.9719, std.dev.: 0.0062)
  SingleSource/UnitTests/Vector/constpool: -4.23% (9.4133 => 9.0148, std.dev.: 0.0755)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.06% (1.2622 => 1.2109, std.dev.: 0.0174)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.96% (6.0996 => 5.8579, std.dev.: 0.0206)
  MultiSource/Applications/d/make_dparser: -3.79% (3.7059 => 3.5656, std.dev.: 0.0532)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.77% (1.3513 => 1.3004, std.dev.: 0.0176)
  SingleSource/Benchmarks/Shootout-C++/lists1: -3.52% (0.3186 => 0.3074, std.dev.: 0.0013)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.02% (0.5301 => 0.5141, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.21% (1.3147 => 1.2857, std.dev.: 0.0096)
  MultiSource/Applications/Burg/burg: -2.06% (1.4398 => 1.4102, std.dev.: 0.0054)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.04% (2.8232 => 2.7657, std.dev.: 0.0016)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.59% (0.6399 => 0.6297, std.dev.: 0.0010)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -38.10% (0.0357 => 0.0221, std.dev.: 0.0014)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -31.85% (2.1448 => 1.4617, std.dev.: 0.1238)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -31.26% (4.2735 => 2.9376, std.dev.: 0.0810)
  SingleSource/Benchmarks/Shootout-C++/ary3: -18.73% (5.4029 => 4.3910, std.dev.: 0.1951)
  SingleSource/Benchmarks/Shootout/heapsort: -17.47% (3.4950 => 2.8845, std.dev.: 0.0853)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -7.22% (38.3111 => 35.5437, std.dev.: 0.3217)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.69% (30.5303 => 28.4883, std.dev.: 0.2180)
  SingleSource/Benchmarks/Shootout-C++/lists1: -5.56% (0.6187 => 0.5843, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -4.22% (2.3171 => 2.2193, std.dev.: 0.0185)
  SingleSource/Benchmarks/Dhrystone/dry: -3.45% (0.4953 => 0.4782, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout/hash: -2.50% (5.2908 => 5.1583, std.dev.: 0.0234)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.43% (61.9561 => 60.4481, std.dev.: 0.1729)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.76% (3.7047 => 3.6395, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.73% (4.8949 => 4.8102, std.dev.: 0.0260)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.72% (6.0413 => 5.9372, std.dev.: 0.0402)
  SingleSource/Benchmarks/Misc/salsa20: -1.27% (7.5777 => 7.4816, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.22% (4.0916 => 4.0417, std.dev.: 0.0028)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 56.44% (1.6685 => 2.6102, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/matrix: 30.46% (2.8607 => 3.7320, std.dev.: 0.1385)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.56% (1.4795 => 1.8872, std.dev.: 0.0184)
  SingleSource/Benchmarks/Shootout/matrix: 17.40% (1.7960 => 2.1085, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/ReedSolomon: 14.96% (8.5010 => 9.7730, std.dev.: 0.0040)
  SingleSource/Benchmarks/Stanford/Puzzle: 7.13% (0.1668 => 0.1787, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout/lists: 6.19% (6.9930 => 7.4258, std.dev.: 0.0555)
  SingleSource/Benchmarks/Misc/fp-convert: 5.28% (7.3892 => 7.7791, std.dev.: 0.0393)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.73% (0.6939 => 0.7267, std.dev.: 0.0012)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.01% (15.5356 => 16.1591, std.dev.: 0.1165)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.73% (4.1840 => 4.3401, std.dev.: 0.0302)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.03% (5.4994 => 5.6659, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.76% (6.5291 => 6.7092, std.dev.: 0.0203)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.73% (1.5797 => 1.6228, std.dev.: 0.0109)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.51% (1.5986 => 1.6387, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.11% (3.1547 => 3.2212, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.00% (5.5032 => 5.6135, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc/oourafft: 1.96% (3.6501 => 3.7216, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.42% (2.8940 => 2.9352, std.dev.: 0.0053)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.42% (2.3882 => 2.4220, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.23% (5.9583 => 6.0314, std.dev.: 0.0073)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.60% (0.0688 => 0.0505, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.28% (1.3676 => 1.2817, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.01% (1.3127 => 1.2469, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.00% (1.3819 => 1.3128, std.dev.: 0.0089)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.81% (1.0197 => 0.9707, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.34% (1.2824 => 1.2267, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.37% (1.3457 => 1.3004, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.47% (1.3182 => 1.2857, std.dev.: 0.0096)
  SingleSource/UnitTests/Vector/constpool: -2.20% (9.2178 => 9.0148, std.dev.: 0.0755)
  MultiSource/Applications/Burg/burg: -1.14% (1.4265 => 1.4102, std.dev.: 0.0054)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.39% (2.8850 => 2.3832, std.dev.: 0.0678)
  MultiSource/Benchmarks/nbench/nbench: -4.01% (23.4696 => 22.5286, std.dev.: 0.1529)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.69% (2.3043 => 2.2193, std.dev.: 0.0185)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.06% (6.0535 => 5.8681, std.dev.: 0.0312)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (40.4190 => 39.3152, std.dev.: 0.4111)
  SingleSource/Benchmarks/Misc/salsa20: -1.49% (7.5947 => 7.4816, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.03% (61.0792 => 60.4481, std.dev.: 0.1729)

Report Time: 0.64s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131204/ba14a90c/attachment.html>


More information about the llvm-testresults mailing list