[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Dec 18 13:09:56 PST 2013


http://llvm.org/perf/db_default/v4/nts/18592?compare_to=18583&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18592, Order: 197595, Start Time: 2013-12-18 19:26:43, End Time: 2013-12-18 21:14:17
      To: 18583, Order: 197584, Start Time: 2013-12-18 17:10:49, End Time: 2013-12-18 19:00:28
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 26 (39 on baseline)
Performance Improvements: 18 (10 on baseline)
Unchanged Tests: 1066 (1061 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/constpool: 20.19% (9.2747 => 11.1470, std.dev.: 0.5443)
  MultiSource/Applications/viterbi/viterbi: 14.72% (0.2011 => 0.2307, std.dev.: 0.0098)
  MultiSource/Applications/JM/lencod/lencod: 8.83% (17.5747 => 19.1269, std.dev.: 0.0707)
  MultiSource/Applications/JM/ldecod/ldecod: 8.81% (7.7588 => 8.4424, std.dev.: 0.1792)
  MultiSource/Applications/d/make_dparser: 7.56% (3.5842 => 3.8552, std.dev.: 0.0828)
  MultiSource/Applications/SPASS/SPASS: 6.89% (16.6731 => 17.8221, std.dev.: 0.3699)
  MultiSource/Applications/SIBsim4/SIBsim4: 6.62% (1.5719 => 1.6760, std.dev.: 0.0318)
  MultiSource/Applications/oggenc/oggenc: 5.39% (5.7412 => 6.0505, std.dev.: 0.0809)
  MultiSource/Applications/siod/siod: 4.60% (2.6230 => 2.7437, std.dev.: 0.0202)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.28% (1.1426 => 1.1915, std.dev.: 0.0130)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 55.39% (0.7772 => 1.2077, std.dev.: 0.0826)
  SingleSource/Benchmarks/Shootout/heapsort: 29.11% (3.4790 => 4.4919, std.dev.: 0.0753)
  MultiSource/Benchmarks/Olden/em3d/em3d: 17.96% (4.6207 => 5.4508, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/flops: 17.43% (7.8968 => 9.2735, std.dev.: 0.1608)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 12.41% (4.1268 => 4.6390, std.dev.: 0.1249)
  MultiSource/Benchmarks/Olden/bisort/bisort: 10.85% (0.6758 => 0.7491, std.dev.: 0.0214)
  SingleSource/Benchmarks/Shootout/hash: 7.69% (5.0497 => 5.4380, std.dev.: 0.0642)
  MultiSource/Benchmarks/llubenchmark/llu: 5.22% (2.0330 => 2.1392, std.dev.: 0.0370)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.58% (0.6923 => 0.7240, std.dev.: 0.0027)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.11% (1.0385 => 1.0812, std.dev.: 0.0108)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.75% (0.5095 => 0.5286, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout-C++/hash: 3.08% (0.7269 => 0.7493, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.54% (4.7956 => 4.9175, std.dev.: 0.0297)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.51% (1.4398 => 1.4759, std.dev.: 0.0093)
  SingleSource/Benchmarks/Misc/ffbench: 2.10% (1.4063 => 1.4359, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout/random: 1.29% (2.4484 => 2.4799, std.dev.: 0.0025)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2002-05-02-ManyArguments: -41.34% (0.0329 => 0.0193, std.dev.: 0.0051)
  SingleSource/Benchmarks/Misc/salsa20: -39.77% (0.0865 => 0.0521, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout/random: -23.16% (0.0475 => 0.0365, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -8.13% (0.2103 => 0.1932, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -7.77% (1.3916 => 1.2835, std.dev.: 0.0337)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.97% (1.3865 => 1.2899, std.dev.: 0.0206)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.60% (0.2072 => 0.1956, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.27% (1.2737 => 1.2193, std.dev.: 0.0114)
  SingleSource/Benchmarks/Shootout-C++/hash: -4.18% (0.4164 => 0.3990, std.dev.: 0.0065)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -8.63% (0.1542 => 0.1409, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/salsa20: -7.99% (8.1509 => 7.4993, std.dev.: 0.0491)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.55% (0.1602 => 0.1497, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/mandel-2: -5.29% (0.8868 => 0.8399, std.dev.: 0.0003)
  MultiSource/Benchmarks/Olden/health/health: -5.04% (0.3489 => 0.3313, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.39% (5.3234 => 5.0895, std.dev.: 0.0548)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -3.78% (3.2155 => 3.0940, std.dev.: 0.0131)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.29% (63.2239 => 61.7749, std.dev.: 0.5127)
  SingleSource/Benchmarks/Shootout/lists: -1.28% (7.1897 => 7.0974, std.dev.: 0.0246)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 51.69% (15.7419 => 23.8792, std.dev.: 0.2650)
  SingleSource/UnitTests/Vector/constpool: 20.93% (9.2178 => 11.1470, std.dev.: 0.5443)
  MultiSource/Applications/viterbi/viterbi: 14.15% (0.2021 => 0.2307, std.dev.: 0.0098)
  MultiSource/Applications/lemon/lemon: 11.29% (1.2200 => 1.3577, std.dev.: 0.0280)
  MultiSource/Applications/JM/lencod/lencod: 10.58% (17.2968 => 19.1269, std.dev.: 0.0707)
  MultiSource/Applications/SIBsim4/SIBsim4: 10.28% (1.5198 => 1.6760, std.dev.: 0.0318)
  MultiSource/Applications/JM/ldecod/ldecod: 10.27% (7.6560 => 8.4424, std.dev.: 0.1792)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.22% (0.1145 => 0.1262, std.dev.: 0.0011)
  MultiSource/Applications/oggenc/oggenc: 10.07% (5.4968 => 6.0505, std.dev.: 0.0809)
  MultiSource/Applications/siod/siod: 7.63% (2.5491 => 2.7437, std.dev.: 0.0202)
  MultiSource/Applications/SPASS/SPASS: 6.61% (16.7177 => 17.8221, std.dev.: 0.3699)
  MultiSource/Benchmarks/McCat/08-main/main: 4.09% (0.3007 => 0.3130, std.dev.: 0.0021)
  MultiSource/Benchmarks/McCat/09-vor/vor: 3.75% (0.3596 => 0.3731, std.dev.: 0.0017)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 57.46% (0.7670 => 1.2077, std.dev.: 0.0826)
  SingleSource/Benchmarks/Shootout/heapsort: 52.31% (2.9492 => 4.4919, std.dev.: 0.0753)
  MultiSource/Benchmarks/Olden/em3d/em3d: 18.18% (4.6123 => 5.4508, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.21% (5.9583 => 6.9837, std.dev.: 0.1230)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 14.35% (4.0567 => 4.6390, std.dev.: 0.1249)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.33% (28.6638 => 32.4841, std.dev.: 0.5312)
  MultiSource/Benchmarks/Olden/bisort/bisort: 11.27% (0.6732 => 0.7491, std.dev.: 0.0214)
  SingleSource/Benchmarks/Shootout-C++/ary3: 9.27% (4.6797 => 5.1134, std.dev.: 0.1263)
  MultiSource/Benchmarks/llubenchmark/llu: 8.24% (1.9763 => 2.1392, std.dev.: 0.0370)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.14% (3.3810 => 3.6561, std.dev.: 0.0582)
  MultiSource/Applications/lua/lua: 7.59% (29.1357 => 31.3463, std.dev.: 0.4101)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.91% (2.8940 => 3.0940, std.dev.: 0.0131)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.67% (1.0232 => 1.0812, std.dev.: 0.0108)
  MultiSource/Applications/siod/siod: 5.60% (3.4258 => 3.6175, std.dev.: 0.0173)
  MultiSource/Applications/SIBsim4/SIBsim4: 5.48% (3.4043 => 3.5907, std.dev.: 0.0488)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.03% (4.0012 => 4.2025, std.dev.: 0.0395)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.98% (0.6261 => 0.6573, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout/hash: 4.79% (5.1896 => 5.4380, std.dev.: 0.0642)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.34% (0.6939 => 0.7240, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/fp-convert: 3.53% (7.3892 => 7.6502, std.dev.: 0.0800)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.40% (0.5112 => 0.5286, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.74% (1.4366 => 1.4759, std.dev.: 0.0093)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.93% (4.8243 => 4.9175, std.dev.: 0.0297)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.84% (11.7894 => 12.0066, std.dev.: 0.0638)
  SingleSource/Benchmarks/Misc/ffbench: 1.82% (1.4103 => 1.4359, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout/lists: 1.49% (6.9930 => 7.0974, std.dev.: 0.0246)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.61% (0.2824 => 0.2609, std.dev.: 0.0051)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.42% (0.2540 => 0.2377, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.20% (1.3676 => 1.2828, std.dev.: 0.0219)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.09% (0.1774 => 0.1666, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.78% (1.4277 => 1.3594, std.dev.: 0.0213)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.49% (1.3505 => 1.2899, std.dev.: 0.0206)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.95% (1.2544 => 1.2048, std.dev.: 0.0115)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/sim/sim: -5.19% (4.0134 => 3.8050, std.dev.: 0.0394)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.85% (6.0535 => 5.8811, std.dev.: 0.0525)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.53% (7.9597 => 7.8377, std.dev.: 0.0045)

Report Time: 1.65s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131218/613dea2c/attachment.html>


More information about the llvm-testresults mailing list