[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 3 04:45:41 PST 2013


http://llvm.org/perf/db_default/v4/nts/17881?compare_to=17873&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17881, Order: 196265, Start Time: 2013-12-03 11:02:22, End Time: 2013-12-03 12:49:46
      To: 17873, Order: 196255, Start Time: 2013-12-03 08:51:40, End Time: 2013-12-03 10:38:32
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 31 (37 on baseline)
Performance Improvements: 15 (10 on baseline)
Unchanged Tests: 1064 (1063 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 61.78% (0.0471 => 0.0762, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout/strcat: 55.34% (0.0309 => 0.0480, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 53.25% (0.0676 => 0.1036, std.dev.: 0.0059)
  SingleSource/Benchmarks/Misc/mandel-2: 40.06% (0.0362 => 0.0507, std.dev.: 0.0034)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 37.08% (0.9683 => 1.3273, std.dev.: 0.0349)
  SingleSource/Benchmarks/Shootout/lists: 33.16% (0.0790 => 0.1052, std.dev.: 0.0087)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 28.43% (0.1488 => 0.1911, std.dev.: 0.0116)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 22.63% (1.1433 => 1.4020, std.dev.: 0.0748)
  MultiSource/Benchmarks/BitBench/five11/five11: 17.37% (0.0616 => 0.0723, std.dev.: 0.0001)
  MultiSource/Applications/lua/lua: 15.97% (4.3594 => 5.0555, std.dev.: 0.2075)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.32% (0.2612 => 0.2986, std.dev.: 0.0141)
  MultiSource/Applications/ClamAV/clamscan: 6.17% (17.4932 => 18.5732, std.dev.: 0.3401)
  MultiSource/Applications/oggenc/oggenc: 4.92% (5.5178 => 5.7891, std.dev.: 0.0221)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.30% (1.2280 => 1.2563, std.dev.: 0.0088)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 53.13% (0.1359 => 0.2081, std.dev.: 0.0244)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 45.96% (0.0235 => 0.0343, std.dev.: 0.0010)
  MultiSource/Applications/minisat/minisat: 25.78% (6.3528 => 7.9903, std.dev.: 0.1557)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.39% (2.4237 => 3.0391, std.dev.: 0.1674)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 23.96% (0.1590 => 0.1971, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout/heapsort: 17.70% (3.7512 => 4.4150, std.dev.: 0.1296)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 16.06% (4.0569 => 4.7086, std.dev.: 0.2037)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.03% (29.0972 => 33.1808, std.dev.: 0.3399)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.63% (5.3341 => 5.7942, std.dev.: 0.0707)
  SingleSource/Benchmarks/Shootout-C++/fibo: 8.02% (4.9937 => 5.3940, std.dev.: 0.0056)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.78% (0.3375 => 0.3570, std.dev.: 0.0022)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.08% (3.3523 => 3.4891, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.73% (2.4805 => 2.5482, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.64% (5.2977 => 5.4375, std.dev.: 0.0008)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.61% (1.2459 => 1.2660, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.18% (3.5327 => 3.5743, std.dev.: 0.0050)
  MultiSource/Applications/sqlite3/sqlite3: 1.17% (4.2357 => 4.2854, std.dev.: 0.0126)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/recursive: -41.25% (0.0543 => 0.0319, std.dev.: 0.0038)
  SingleSource/Benchmarks/Stanford/Queens: -36.78% (0.0696 => 0.0440, std.dev.: 0.0097)
  SingleSource/Benchmarks/Stanford/FloatMM: -32.04% (0.0671 => 0.0456, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/perlin: -26.88% (0.0837 => 0.0612, std.dev.: 0.0016)
  MultiSource/Applications/viterbi/viterbi: -24.21% (0.2858 => 0.2166, std.dev.: 0.0121)
  SingleSource/Benchmarks/Misc/oourafft: -3.86% (0.2591 => 0.2491, std.dev.: 0.0036)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary3: -18.66% (6.1381 => 4.9927, std.dev.: 0.2057)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.63% (3.6509 => 3.3722, std.dev.: 0.0838)
  SingleSource/Benchmarks/Dhrystone/fldry: -7.50% (0.7302 => 0.6754, std.dev.: 0.0031)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.34% (1.2960 => 1.2397, std.dev.: 0.0092)
  SingleSource/Benchmarks/Shootout-C++/lists: -2.95% (16.1343 => 15.6579, std.dev.: 0.1668)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.23% (6.0126 => 5.8783, std.dev.: 0.0103)
  SingleSource/Benchmarks/Shootout/lists: -1.80% (7.2305 => 7.1000, std.dev.: 0.0485)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.68% (4.1817 => 4.1114, std.dev.: 0.0228)
  MultiSource/Applications/lua/lua: -1.52% (29.9283 => 29.4738, std.dev.: 0.0511)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 67.84% (0.0454 => 0.0762, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout/strcat: 63.82% (0.0293 => 0.0480, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 51.46% (0.0684 => 0.1036, std.dev.: 0.0059)
  SingleSource/Benchmarks/Misc/mandel-2: 50.45% (0.0337 => 0.0507, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout/lists: 32.66% (0.0793 => 0.1052, std.dev.: 0.0087)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.17% (1.0197 => 1.3273, std.dev.: 0.0349)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 26.31% (0.1513 => 0.1911, std.dev.: 0.0116)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 19.15% (1.1767 => 1.4020, std.dev.: 0.0748)
  MultiSource/Applications/lua/lua: 18.29% (4.2737 => 5.0555, std.dev.: 0.2075)
  MultiSource/Applications/ClamAV/clamscan: 9.47% (16.9661 => 18.5732, std.dev.: 0.3401)
  MultiSource/Applications/SIBsim4/SIBsim4: 9.47% (1.5198 => 1.6637, std.dev.: 0.0520)
  SingleSource/Benchmarks/Shootout-C++/moments: 5.46% (0.3825 => 0.4034, std.dev.: 0.0075)
  MultiSource/Applications/oggenc/oggenc: 5.32% (5.4968 => 5.7891, std.dev.: 0.0221)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 54.72% (0.1345 => 0.2081, std.dev.: 0.0244)
  SingleSource/Benchmarks/Shootout/heapsort: 49.70% (2.9492 => 4.4150, std.dev.: 0.1296)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 45.34% (0.0236 => 0.0343, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 26.60% (4.5769 => 5.7942, std.dev.: 0.0707)
  MultiSource/Applications/minisat/minisat: 25.08% (6.3881 => 7.9903, std.dev.: 0.1557)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 16.07% (4.0567 => 4.7086, std.dev.: 0.2037)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.76% (28.6638 => 33.1808, std.dev.: 0.3399)
  SingleSource/Benchmarks/Stanford/Puzzle: 9.41% (0.1668 => 0.1825, std.dev.: 0.0024)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 8.54% (2.1020 => 2.2815, std.dev.: 0.0559)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (5.0320 => 5.3940, std.dev.: 0.0056)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 6.69% (0.3346 => 0.3570, std.dev.: 0.0022)
  MultiSource/Applications/sgefa/sgefa: 4.35% (0.8745 => 0.9125, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.18% (40.5530 => 42.2494, std.dev.: 0.5671)
  SingleSource/Benchmarks/Misc/flops: 3.91% (9.2673 => 9.6298, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.60% (5.2486 => 5.4375, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.44% (3.5027 => 3.6233, std.dev.: 0.0447)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.27% (0.5112 => 0.5279, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/fp-convert: 2.84% (7.3892 => 7.5988, std.dev.: 0.0331)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.49% (3.4043 => 3.4891, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.15% (1.5797 => 1.6137, std.dev.: 0.0120)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.83% (2.5025 => 2.5482, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.58% (1.2463 => 1.2660, std.dev.: 0.0052)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (2.4894 => 2.5194, std.dev.: 0.0045)
  MultiSource/Applications/lua/lua: 1.16% (29.1357 => 29.4738, std.dev.: 0.0511)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -10.26% (0.3247 => 0.2914, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.33% (1.3676 => 1.2810, std.dev.: 0.0306)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.23% (1.4277 => 1.3388, std.dev.: 0.0263)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.43% (1.3146 => 1.2563, std.dev.: 0.0088)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.30% (1.1409 => 1.0918, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.28% (1.3551 => 1.3107, std.dev.: 0.0108)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.91% (10.3096 => 10.1122, std.dev.: 0.0696)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except: -5.41% (0.4987 => 0.4717, std.dev.: 0.0087)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.58% (6.0535 => 5.8369, std.dev.: 0.0300)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.09% (6.8826 => 6.6697, std.dev.: 0.0510)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131203/706dc384/attachment.html>


More information about the llvm-testresults mailing list