[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 16 05:41:25 PST 2013


http://llvm.org/perf/db_default/v4/nts/18480?compare_to=18476&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18480, Order: 197380, Start Time: 2013-12-16 12:03:15, End Time: 2013-12-16 13:45:46
      To: 18476, Order: 197369, Start Time: 2013-12-16 09:55:04, End Time: 2013-12-16 11:36:36
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 21 (34 on baseline)
Performance Improvements: 3 (24 on baseline)
Unchanged Tests: 1086 (1052 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.59% (1.0710 => 1.1094, std.dev.: 0.0100)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.45% (0.5504 => 0.5694, std.dev.: 0.0022)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.20% (0.3535 => 0.3648, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.00% (0.7064 => 0.7276, std.dev.: 0.0070)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.05% (3.1615 => 3.5424, std.dev.: 0.0046)
  SingleSource/Benchmarks/Stanford/Puzzle: 10.44% (0.1619 => 0.1788, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout/sieve: 9.78% (6.9912 => 7.6748, std.dev.: 0.2185)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 7.22% (3.7597 => 4.0310, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.93% (3.5052 => 3.7130, std.dev.: 0.0092)
  SingleSource/Benchmarks/Misc/pi: 5.05% (2.4791 => 2.6044, std.dev.: 0.0030)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.59% (4.2071 => 4.4003, std.dev.: 0.0029)
  MultiSource/Applications/aha/aha: 3.67% (3.5541 => 3.6845, std.dev.: 0.0392)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.58% (6.9866 => 7.2367, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.57% (5.2043 => 5.3902, std.dev.: 0.0068)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.83% (3.7262 => 3.8318, std.dev.: 0.0019)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.11% (18.5876 => 18.9803, std.dev.: 0.0337)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.81% (1.5819 => 1.6106, std.dev.: 0.0080)
  SingleSource/Benchmarks/Shootout/heapsort: 1.48% (2.8937 => 2.9366, std.dev.: 0.0165)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 1.40% (1.4779 => 1.4986, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/mandel: 1.26% (1.0531 => 1.0664, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout/lists: 1.11% (7.4234 => 7.5058, std.dev.: 0.0034)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/ReedSolomon: -8.41% (9.7766 => 8.9540, std.dev.: 0.1906)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -4.90% (2.9580 => 2.8131, std.dev.: 0.0056)
  MultiSource/Applications/viterbi/viterbi: -2.09% (2.6902 => 2.6339, std.dev.: 0.0177)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 39.77% (15.7419 => 22.0018, std.dev.: 1.0613)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 27.36% (0.3859 => 0.4915, std.dev.: 0.0028)
  MultiSource/Applications/lemon/lemon: 8.82% (1.2200 => 1.3276, std.dev.: 0.0362)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.32% (25.9661 => 27.3485, std.dev.: 0.3057)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.76% (0.6412 => 0.6653, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.44% (1.0830 => 1.1094, std.dev.: 0.0100)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.95% (0.6322 => 0.6445, std.dev.: 0.0007)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 56.09% (1.6685 => 2.6044, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout-C++/matrix: 37.62% (2.8607 => 3.9368, std.dev.: 0.0408)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.46% (5.9583 => 7.2367, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout/matrix: 17.23% (1.7960 => 2.1054, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout/sieve: 13.78% (6.7454 => 7.6748, std.dev.: 0.2185)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.15% (3.1585 => 3.5424, std.dev.: 0.0046)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.30% (1.3838 => 1.4986, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout/lists: 7.33% (6.9930 => 7.5058, std.dev.: 0.0034)
  SingleSource/Benchmarks/Stanford/Puzzle: 7.19% (0.1668 => 0.1788, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc/fp-convert: 6.71% (7.3892 => 7.8852, std.dev.: 0.0114)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.12% (1.2278 => 1.3029, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.00% (3.5027 => 3.7130, std.dev.: 0.0092)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.33% (1.1019 => 1.1606, std.dev.: 0.0180)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.17% (4.1840 => 4.4003, std.dev.: 0.0029)
  MultiSource/Applications/siod/siod: 4.80% (3.4258 => 3.5901, std.dev.: 0.0425)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.14% (3.4043 => 3.5451, std.dev.: 0.0387)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.91% (0.6939 => 0.7210, std.dev.: 0.0034)
  MultiSource/Applications/aha/aha: 3.37% (3.5645 => 3.6845, std.dev.: 0.0392)
  SingleSource/Benchmarks/McGill/misr: 3.15% (0.4029 => 0.4156, std.dev.: 0.0001)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.86% (0.5112 => 0.5258, std.dev.: 0.0011)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.69% (3.7315 => 3.8318, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.20% (1.4366 => 1.4682, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.04% (11.7894 => 12.0303, std.dev.: 0.0246)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.96% (1.5797 => 1.6106, std.dev.: 0.0080)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.94% (18.6185 => 18.9803, std.dev.: 0.0337)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.77% (2.5025 => 2.5468, std.dev.: 0.0028)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.67% (2.4894 => 2.5310, std.dev.: 0.0038)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.89% (0.0688 => 0.0503, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -15.89% (0.1938 => 0.1630, std.dev.: 0.0087)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -10.08% (0.3402 => 0.3059, std.dev.: 0.0120)
  MultiSource/Benchmarks/Bullet/bullet: -9.91% (36.6274 => 32.9991, std.dev.: 0.8842)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.80% (5.8749 => 5.4164, std.dev.: 0.0046)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.34% (1.5034 => 1.3931, std.dev.: 0.0305)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.55% (1.3676 => 1.2780, std.dev.: 0.0275)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.51% (0.6882 => 0.6434, std.dev.: 0.0137)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.45% (2.0207 => 1.8904, std.dev.: 0.0177)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.20% (0.2824 => 0.2649, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.52% (1.3819 => 1.3056, std.dev.: 0.0295)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.50% (1.2914 => 1.2333, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.32% (1.2824 => 1.2270, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.25% (1.3157 => 1.2598, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.75% (1.3264 => 1.2767, std.dev.: 0.0053)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.38% (10.3096 => 10.0639, std.dev.: 0.0718)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -36.31% (0.0369 => 0.0235, std.dev.: 0.0035)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.10% (10.0217 => 9.1100, std.dev.: 0.1905)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -6.06% (2.9945 => 2.8131, std.dev.: 0.0056)
  MultiSource/Benchmarks/Bullet/bullet: -5.63% (7.4226 => 7.0044, std.dev.: 0.0375)
  MultiSource/Benchmarks/sim/sim: -5.12% (4.0134 => 3.8079, std.dev.: 0.0443)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.68% (6.8826 => 6.5604, std.dev.: 0.0955)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.93% (6.0535 => 5.8155, std.dev.: 0.0489)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.52% (21.5962 => 21.2684, std.dev.: 0.1259)

Report Time: 0.89s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131216/4599afb7/attachment.html>


More information about the llvm-testresults mailing list