[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Dec 27 21:58:08 PST 2013


http://llvm.org/perf/db_default/v4/nts/19156?compare_to=19151&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19156, Order: 198095, Start Time: 2013-12-28 04:20:54, End Time: 2013-12-28 06:02:41
      To: 19151, Order: 198089, Start Time: 2013-12-28 02:13:52, End Time: 2013-12-28 03:58:27
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 20 (36 on baseline)
Performance Improvements: 8 (25 on baseline)
Unchanged Tests: 1082 (1049 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 44.11% (1.6467 => 2.3730, std.dev.: 0.1122)
  SingleSource/Benchmarks/Shootout/matrix: 16.09% (1.8118 => 2.1033, std.dev.: 0.0043)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 8.30% (0.4818 => 0.5218, std.dev.: 0.0003)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 7.31% (1.1138 => 1.1952, std.dev.: 0.0125)
  SingleSource/Benchmarks/Shootout/lists: 5.22% (7.1190 => 7.4905, std.dev.: 0.0058)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 4.49% (81.9725 => 85.6534, std.dev.: 0.9181)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.41% (4.2143 => 4.4002, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 3.79% (0.4777 => 0.4958, std.dev.: 0.0021)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.81% (3.7308 => 3.8355, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/fp-convert: 2.79% (7.6365 => 7.8497, std.dev.: 0.0095)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.65% (0.3885 => 0.3988, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/hash: 2.13% (5.0159 => 5.1226, std.dev.: 0.0296)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.00% (5.2661 => 5.3712, std.dev.: 0.0317)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.91% (3.4847 => 3.5514, std.dev.: 0.0216)
  SingleSource/Benchmarks/Misc/oourafft: 1.72% (3.6646 => 3.7276, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout/fib2: 1.60% (3.5956 => 3.6533, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout/methcall: 1.41% (8.4978 => 8.6173, std.dev.: 0.0331)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.37% (3.1451 => 3.1881, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.26% (1.4477 => 1.4660, std.dev.: 0.0032)
  MultiSource/Benchmarks/Bullet/bullet: 1.09% (6.9286 => 7.0042, std.dev.: 0.0062)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/SmallPT/smallpt: -6.79% (0.1502 => 0.1400, std.dev.: 0.0013)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -3.04% (0.3521 => 0.3414, std.dev.: 0.0022)
  MultiSource/Applications/hbd/hbd: -1.36% (1.5674 => 1.5461, std.dev.: 0.0068)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -14.43% (33.1998 => 28.4091, std.dev.: 0.1317)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -4.19% (3.9899 => 3.8228, std.dev.: 0.0583)
  MultiSource/Applications/sgefa/sgefa: -3.32% (0.9045 => 0.8745, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout/heapsort: -3.26% (2.9626 => 2.8661, std.dev.: 0.0348)
  SingleSource/Benchmarks/Misc/ffbench: -2.87% (1.4267 => 1.3857, std.dev.: 0.0064)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 38.73% (15.7419 => 21.8388, std.dev.: 1.1807)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.41% (0.3859 => 0.4878, std.dev.: 0.0098)
  MultiSource/Applications/lemon/lemon: 9.22% (1.2200 => 1.3325, std.dev.: 0.0252)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.17% (25.9661 => 27.3092, std.dev.: 0.5079)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.34% (0.6412 => 0.6626, std.dev.: 0.0029)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.21% (1.0830 => 1.1069, std.dev.: 0.0031)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.93% (0.6322 => 0.6444, std.dev.: 0.0008)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 42.22% (1.6685 => 2.3730, std.dev.: 0.1122)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 20.10% (5.9583 => 7.1557, std.dev.: 0.0424)
  SingleSource/Benchmarks/Shootout/matrix: 17.11% (1.7960 => 2.1033, std.dev.: 0.0043)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.47% (1.1019 => 1.1952, std.dev.: 0.0125)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.91% (3.3810 => 3.6486, std.dev.: 0.0089)
  SingleSource/Benchmarks/Shootout/lists: 7.11% (6.9930 => 7.4905, std.dev.: 0.0058)
  SingleSource/Benchmarks/Stanford/Puzzle: 6.24% (0.1668 => 0.1772, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/fp-convert: 6.23% (7.3892 => 7.8497, std.dev.: 0.0095)
  MultiSource/Applications/aha/aha: 6.06% (3.5645 => 3.7805, std.dev.: 0.0034)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.56% (0.6261 => 0.6609, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.17% (4.1840 => 4.4002, std.dev.: 0.0052)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.83% (0.6939 => 0.7274, std.dev.: 0.0008)
  MultiSource/Applications/siod/siod: 4.71% (3.4258 => 3.5870, std.dev.: 0.0113)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.32% (3.4043 => 3.5514, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.22% (5.0601 => 5.2736, std.dev.: 0.0138)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 4.13% (82.2592 => 85.6534, std.dev.: 0.9181)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.79% (3.7315 => 3.8355, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout/ary3: 2.34% (4.5977 => 4.7052, std.dev.: 0.0241)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.34% (5.2486 => 5.3712, std.dev.: 0.0317)
  SingleSource/Benchmarks/Misc/oourafft: 2.12% (3.6501 => 3.7276, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.11% (1.5797 => 1.6130, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.07% (3.1547 => 3.2199, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.05% (1.4366 => 1.4660, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.98% (5.9126 => 6.0294, std.dev.: 0.0408)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.96% (11.7894 => 12.0200, std.dev.: 0.0490)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.60% (2.8940 => 2.9404, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout/fib2: 1.59% (3.5960 => 3.6533, std.dev.: 0.0043)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.35% (3.1455 => 3.1881, std.dev.: 0.0044)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.11% (6.7756 => 6.8505, std.dev.: 0.0007)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.31% (0.0688 => 0.0507, std.dev.: 0.0007)
  MultiSource/Benchmarks/Bullet/bullet: -9.44% (36.6274 => 33.1683, std.dev.: 1.0944)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.68% (0.2540 => 0.2345, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.48% (5.8749 => 5.4353, std.dev.: 0.0132)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -7.36% (1.0197 => 0.9447, std.dev.: 0.0127)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.53% (0.3247 => 0.3035, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.99% (1.3676 => 1.2857, std.dev.: 0.0273)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.67% (0.2824 => 0.2664, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.77% (1.3460 => 1.2818, std.dev.: 0.0178)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.77% (1.1409 => 1.0865, std.dev.: 0.0114)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.64% (1.4449 => 1.3778, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.55% (1.4113 => 1.3471, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.49% (1.3146 => 1.2556, std.dev.: 0.0197)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.41% (1.3505 => 1.2910, std.dev.: 0.0210)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.91% (1.2914 => 1.2409, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.71% (1.4125 => 1.3601, std.dev.: 0.0090)
  MultiSource/Benchmarks/nbench/nbench: -3.21% (1.2647 => 1.2241, std.dev.: 0.0141)
  MultiSource/Applications/d/make_dparser: -2.87% (3.6428 => 3.5384, std.dev.: 0.0368)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.82% (0.5879 => 0.5713, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.29% (4.7807 => 4.6712, std.dev.: 0.0274)
  MultiSource/Applications/hbd/hbd: -1.18% (1.5646 => 1.5461, std.dev.: 0.0068)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.58% (2.8850 => 2.3778, std.dev.: 0.0848)
  MultiSource/Benchmarks/Bullet/bullet: -5.64% (7.4226 => 7.0042, std.dev.: 0.0062)
  MultiSource/Applications/sqlite3/sqlite3: -4.08% (4.2978 => 4.1224, std.dev.: 0.0439)
  SingleSource/Benchmarks/Misc/ffbench: -1.74% (1.4103 => 1.3857, std.dev.: 0.0064)

Report Time: 1.39s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131227/f1b87a22/attachment.html>


More information about the llvm-testresults mailing list