[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 16 12:23:41 PST 2013


http://llvm.org/perf/db_default/v4/nts/18492?compare_to=18488&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18492, Order: 197399, Start Time: 2013-12-16 18:37:38, End Time: 2013-12-16 20:28:00
      To: 18488, Order: 197392, Start Time: 2013-12-16 16:24:41, End Time: 2013-12-16 18:11:21
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 48 (49 on baseline)
Performance Improvements: 4 (7 on baseline)
Unchanged Tests: 1058 (1054 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/PR10189: 63.97% (0.0247 => 0.0405, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/em3d/em3d: 58.29% (0.1973 => 0.3123, std.dev.: 0.0192)
  MultiSource/Benchmarks/Olden/mst/mst: 57.53% (0.1314 => 0.2070, std.dev.: 0.0059)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 54.00% (0.1639 => 0.2524, std.dev.: 0.0037)
  MultiSource/Benchmarks/FreeBench/mason/mason: 50.45% (0.0668 => 0.1005, std.dev.: 0.0108)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 50.14% (0.0730 => 0.1096, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 49.25% (0.5608 => 0.8370, std.dev.: 0.0546)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 48.21% (0.2207 => 0.3271, std.dev.: 0.0272)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 46.08% (0.0753 => 0.1100, std.dev.: 0.0074)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 40.42% (0.0960 => 0.1348, std.dev.: 0.0135)
  SingleSource/Regression/C/sumarray2d: 40.25% (0.0318 => 0.0446, std.dev.: 0.0047)
  SingleSource/Regression/C/uint64_to_float: 37.56% (0.0402 => 0.0553, std.dev.: 0.0017)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 34.40% (0.1660 => 0.2231, std.dev.: 0.0136)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 33.62% (0.8844 => 1.1817, std.dev.: 0.0552)
  MultiSource/Applications/obsequi/Obsequi: 30.78% (1.1614 => 1.5189, std.dev.: 0.0745)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.60% (0.2673 => 0.3491, std.dev.: 0.0134)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.77% (0.6784 => 0.8736, std.dev.: 0.0413)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.55% (0.2331 => 0.2810, std.dev.: 0.0046)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 14.81% (1.4021 => 1.6098, std.dev.: 0.0646)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.91% (27.2155 => 30.1858, std.dev.: 0.2633)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.66% (1.4777 => 1.6056, std.dev.: 0.0295)
  MultiSource/Applications/kimwitu++/kc: 6.59% (18.4684 => 19.6858, std.dev.: 0.4099)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.16% (1.3325 => 1.4012, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.53% (1.3233 => 1.3832, std.dev.: 0.0228)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.40% (2.6090 => 2.6454, std.dev.: 0.0059)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 68.07% (0.7670 => 1.2891, std.dev.: 0.0430)
  MultiSource/Benchmarks/Olden/bisort/bisort: 30.35% (0.6708 => 0.8744, std.dev.: 0.0342)
  MultiSource/Benchmarks/FreeBench/neural/neural: 29.05% (0.4485 => 0.5788, std.dev.: 0.0158)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.08% (1.4845 => 1.8568, std.dev.: 0.0241)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 21.37% (2.9459 => 3.5755, std.dev.: 0.0500)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.29% (2.3799 => 2.8866, std.dev.: 0.0955)
  MultiSource/Applications/lemon/lemon: 21.09% (0.8218 => 0.9951, std.dev.: 0.0640)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.22% (2.1007 => 2.3785, std.dev.: 0.0140)
  MultiSource/Applications/SPASS/SPASS: 10.06% (8.3797 => 9.2228, std.dev.: 0.1954)
  MultiSource/Applications/obsequi/Obsequi: 9.56% (2.3028 => 2.5229, std.dev.: 0.0312)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.44% (35.6229 => 38.9868, std.dev.: 1.1419)
  SingleSource/Benchmarks/McGill/misr: 7.37% (0.3827 => 0.4109, std.dev.: 0.0022)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.79% (15.2136 => 16.2472, std.dev.: 0.0548)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.94% (0.6942 => 0.7285, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.83% (4.1055 => 4.3038, std.dev.: 0.0078)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.08% (2.6664 => 2.7751, std.dev.: 0.0316)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.77% (3.4743 => 3.6053, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/flops: 3.72% (9.2715 => 9.6164, std.dev.: 0.0159)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.47% (95.3329 => 98.6393, std.dev.: 0.5954)
  SingleSource/Benchmarks/Misc/flops-4: 3.10% (1.7225 => 1.7759, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/oourafft: 2.49% (3.6441 => 3.7349, std.dev.: 0.0155)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.31% (1.2431 => 1.2718, std.dev.: 0.0053)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (5.4327 => 5.4964, std.dev.: 0.0161)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.76% (5.4078 => 5.2583, std.dev.: 0.0298)
  MultiSource/Applications/hexxagon/hexxagon: -2.58% (15.3625 => 14.9656, std.dev.: 0.0903)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.84% (6.0673 => 5.9557, std.dev.: 0.0310)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.30% (1.9977 => 1.9717, std.dev.: 0.0036)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 59.77% (0.0686 => 0.1096, std.dev.: 0.0042)
  SingleSource/Regression/C/PR10189: 55.77% (0.0260 => 0.0405, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/em3d/em3d: 54.68% (0.2019 => 0.3123, std.dev.: 0.0192)
  MultiSource/Benchmarks/Olden/mst/mst: 51.21% (0.1369 => 0.2070, std.dev.: 0.0059)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 50.42% (0.1678 => 0.2524, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 47.80% (0.5663 => 0.8370, std.dev.: 0.0546)
  MultiSource/Applications/sqlite3/sqlite3: 46.50% (15.7419 => 23.0622, std.dev.: 0.7319)
  MultiSource/Benchmarks/FreeBench/mason/mason: 46.50% (0.0686 => 0.1005, std.dev.: 0.0108)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 45.57% (0.0926 => 0.1348, std.dev.: 0.0135)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 44.17% (0.0763 => 0.1100, std.dev.: 0.0074)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 43.40% (0.2281 => 0.3271, std.dev.: 0.0272)
  SingleSource/Regression/C/sumarray2d: 39.38% (0.0320 => 0.0446, std.dev.: 0.0047)
  SingleSource/Regression/C/uint64_to_float: 37.56% (0.0402 => 0.0553, std.dev.: 0.0017)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 36.12% (0.1639 => 0.2231, std.dev.: 0.0136)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 33.07% (0.8880 => 1.1817, std.dev.: 0.0552)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 28.16% (0.2724 => 0.3491, std.dev.: 0.0134)
  MultiSource/Applications/obsequi/Obsequi: 27.59% (1.1905 => 1.5189, std.dev.: 0.0745)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.84% (0.6942 => 0.8736, std.dev.: 0.0413)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 16.25% (25.9661 => 30.1858, std.dev.: 0.2633)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.63% (0.2540 => 0.2810, std.dev.: 0.0046)
  MultiSource/Applications/oggenc/oggenc: 6.76% (5.4968 => 5.8684, std.dev.: 0.1168)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.22% (2.5384 => 2.6454, std.dev.: 0.0059)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 68.07% (0.7670 => 1.2891, std.dev.: 0.0430)
  MultiSource/Benchmarks/FreeBench/neural/neural: 37.16% (0.4220 => 0.5788, std.dev.: 0.0158)
  MultiSource/Benchmarks/Olden/bisort/bisort: 29.89% (0.6732 => 0.8744, std.dev.: 0.0342)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.50% (1.4795 => 1.8568, std.dev.: 0.0241)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 19.40% (2.9945 => 3.5755, std.dev.: 0.0500)
  SingleSource/Benchmarks/Shootout-C++/ary3: 16.96% (4.6797 => 5.4735, std.dev.: 0.2983)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.36% (5.9583 => 6.9329, std.dev.: 0.1869)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.15% (2.1020 => 2.3785, std.dev.: 0.0140)
  MultiSource/Applications/obsequi/Obsequi: 9.40% (2.3061 => 2.5229, std.dev.: 0.0312)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 8.39% (35.9684 => 38.9868, std.dev.: 1.1419)
  MultiSource/Applications/SPASS/SPASS: 8.04% (8.5363 => 9.2228, std.dev.: 0.1954)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.05% (1.0232 => 1.0953, std.dev.: 0.0270)
  SingleSource/Benchmarks/Stanford/Puzzle: 6.59% (0.1668 => 0.1778, std.dev.: 0.0036)
  MultiSource/Applications/SIBsim4/SIBsim4: 5.90% (3.4043 => 3.6053, std.dev.: 0.0026)
  MultiSource/Applications/lua/lua: 5.90% (29.1357 => 30.8553, std.dev.: 0.4039)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.99% (0.6939 => 0.7285, std.dev.: 0.0010)
  MultiSource/Applications/siod/siod: 4.87% (3.4258 => 3.5926, std.dev.: 0.0177)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.58% (15.5356 => 16.2472, std.dev.: 0.0548)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.10% (2.6658 => 2.7751, std.dev.: 0.0316)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.80% (4.1462 => 4.3038, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/flops: 3.77% (9.2673 => 9.6164, std.dev.: 0.0159)
  SingleSource/Benchmarks/Misc/flops-4: 2.60% (1.7309 => 1.7759, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/oourafft: 2.32% (3.6501 => 3.7349, std.dev.: 0.0155)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.05% (1.2463 => 1.2718, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout/sieve: 1.65% (6.7454 => 6.8568, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.50% (11.7894 => 11.9662, std.dev.: 0.0647)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.34% (3.1547 => 3.1969, std.dev.: 0.0153)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.73% (1.2824 => 1.2218, std.dev.: 0.0194)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.86% (1.4277 => 1.4012, std.dev.: 0.0060)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -26.25% (0.1973 => 0.1455, std.dev.: 0.0181)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -5.04% (0.3970 => 0.3770, std.dev.: 0.0066)
  MultiSource/Benchmarks/sim/sim: -4.93% (4.0134 => 3.8155, std.dev.: 0.0291)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.65% (5.3463 => 5.2583, std.dev.: 0.0298)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.50% (7.9597 => 7.8401, std.dev.: 0.0350)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131216/d93d2f29/attachment.html>


More information about the llvm-testresults mailing list