[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Jan 5 02:15:26 PST 2014


http://llvm.org/perf/db_default/v4/nts/19735?compare_to=19728&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19735, Order: 198551, Start Time: 2014-01-05 08:36:35, End Time: 2014-01-05 10:20:10
      To: 19728, Order: 198546, Start Time: 2014-01-05 06:26:20, End Time: 2014-01-05 08:13:27
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 17 (32 on baseline)
Performance Improvements: 23 (25 on baseline)
Unchanged Tests: 1070 (1053 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 59.25% (1.6350 => 2.6038, std.dev.: 0.0033)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 6.34% (0.4908 => 0.5219, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout/lists: 5.66% (7.1097 => 7.5119, std.dev.: 0.0665)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.45% (0.6912 => 0.7289, std.dev.: 0.0001)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.03% (0.5034 => 0.5287, std.dev.: 0.0066)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.44% (4.2157 => 4.4027, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc/fp-convert: 4.07% (7.5145 => 7.8203, std.dev.: 0.0301)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.64% (0.3848 => 0.3988, std.dev.: 0.0010)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.26% (1.6391 => 1.6925, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.41% (3.7448 => 3.8349, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc/oourafft: 2.12% (3.6427 => 3.7198, std.dev.: 0.0046)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.91% (2.3766 => 2.4219, std.dev.: 0.0010)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (2.4840 => 2.5310, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.61% (3.1535 => 3.2042, std.dev.: 0.0077)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.52% (3.1494 => 3.1972, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.39% (3.9392 => 3.9940, std.dev.: 0.0137)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.15% (6.7707 => 6.8487, std.dev.: 0.0016)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout/fib2: -36.50% (0.0274 => 0.0174, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout/ary3: -32.08% (0.0477 => 0.0324, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -9.64% (0.3124 => 0.2823, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -9.11% (1.4749 => 1.3406, std.dev.: 0.0098)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.38% (1.0394 => 0.9523, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.15% (1.4173 => 1.3159, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.66% (1.3444 => 1.2683, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.12% (1.2982 => 1.2447, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.06% (1.3412 => 1.2867, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -3.27% (1.3737 => 1.3288, std.dev.: 0.0117)
  SingleSource/Benchmarks/Shootout-C++/moments: -3.07% (0.3936 => 0.3815, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.04% (1.3058 => 1.2661, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.59% (1.3868 => 1.3509, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.15% (1.3149 => 1.2866, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.14% (1.2601 => 1.2331, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (1.3125 => 1.2885, std.dev.: 0.0089)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: -12.54% (5.2061 => 4.5530, std.dev.: 0.2471)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -12.41% (2.7195 => 2.3821, std.dev.: 0.0612)
  SingleSource/Benchmarks/Shootout/nestedloop: -8.07% (0.1624 => 0.1493, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -7.04% (3.0278 => 2.8147, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.81% (3.2540 => 3.1951, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.50% (1.2579 => 1.2390, std.dev.: 0.0051)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.37% (1.7695 => 1.7453, std.dev.: 0.0054)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 41.60% (15.7419 => 22.2908, std.dev.: 0.8241)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 27.86% (0.3859 => 0.4934, std.dev.: 0.0030)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.74% (0.1145 => 0.1268, std.dev.: 0.0022)
  MultiSource/Applications/lemon/lemon: 9.70% (1.2200 => 1.3384, std.dev.: 0.0110)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.99% (0.6412 => 0.6668, std.dev.: 0.0027)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.5198 => 1.5740, std.dev.: 0.0117)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.9915 => 1.0184, std.dev.: 0.0075)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.48% (0.6322 => 0.6479, std.dev.: 0.0003)
  MultiSource/Applications/JM/lencod/lencod: 2.32% (17.2968 => 17.6979, std.dev.: 0.0117)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.60% (0.8787 => 0.8928, std.dev.: 0.0017)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 56.06% (1.6685 => 2.6038, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 15.96% (5.9583 => 6.9094, std.dev.: 0.1545)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.43% (82.2592 => 92.4864, std.dev.: 0.3384)
  SingleSource/Benchmarks/Shootout/lists: 7.42% (6.9930 => 7.5119, std.dev.: 0.0665)
  MultiSource/Applications/lemon/lemon: 6.89% (0.8632 => 0.9227, std.dev.: 0.0172)
  SingleSource/Benchmarks/McGill/chomp: 6.17% (1.0099 => 1.0722, std.dev.: 0.0113)
  SingleSource/Benchmarks/Misc/fp-convert: 5.83% (7.3892 => 7.8203, std.dev.: 0.0301)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.23% (4.1840 => 4.4027, std.dev.: 0.0043)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.04% (0.6939 => 0.7289, std.dev.: 0.0001)
  MultiSource/Applications/siod/siod: 4.79% (3.4258 => 3.5900, std.dev.: 0.0119)
  MultiSource/Applications/sgefa/sgefa: 3.74% (0.8745 => 0.9072, std.dev.: 0.0046)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.42% (0.5112 => 0.5287, std.dev.: 0.0066)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.77% (3.7315 => 3.8349, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.40% (6.5291 => 6.6860, std.dev.: 0.0429)
  SingleSource/Benchmarks/Misc/oourafft: 1.91% (3.6501 => 3.7198, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.82% (1.5986 => 1.6277, std.dev.: 0.0094)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.67% (2.4894 => 2.5310, std.dev.: 0.0036)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.64% (3.1455 => 3.1972, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.57% (3.1547 => 3.2042, std.dev.: 0.0077)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.41% (2.3882 => 2.4219, std.dev.: 0.0010)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.35% (1.6699 => 1.6925, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.08% (6.7756 => 6.8487, std.dev.: 0.0016)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.74% (0.0688 => 0.0504, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -16.51% (0.1938 => 0.1618, std.dev.: 0.0091)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -9.21% (0.3247 => 0.2948, std.dev.: 0.0075)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.35% (5.8749 => 5.4433, std.dev.: 0.0150)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.79% (0.6882 => 0.6415, std.dev.: 0.0060)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -6.61% (1.0197 => 0.9523, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.92% (1.3676 => 1.2867, std.dev.: 0.0040)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.84% (0.2758 => 0.2597, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.29% (1.3146 => 1.2451, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.92% (1.2914 => 1.2278, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.78% (1.3819 => 1.3159, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.57% (1.4277 => 1.3625, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.84% (1.2824 => 1.2331, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.60% (1.3157 => 1.2683, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.55% (1.3127 => 1.2661, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.94% (1.3918 => 1.3509, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.40% (1.3182 => 1.2866, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.16% (1.3702 => 1.3406, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.43% (1.2670 => 1.2489, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.31% (1.3068 => 1.2897, std.dev.: 0.0027)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.43% (2.8850 => 2.3821, std.dev.: 0.0612)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.47% (15.5356 => 13.1330, std.dev.: 0.1492)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -6.00% (2.9945 => 2.8147, std.dev.: 0.0144)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.46% (6.0535 => 5.8443, std.dev.: 0.0337)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -2.14% (2.3355 => 2.2855, std.dev.: 0.0186)

Report Time: 0.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140105/cff98ab2/attachment.html>


More information about the llvm-testresults mailing list