[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 1 14:40:33 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15868?compare_to=15864&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15868, Order: 191786, Start Time: 2013-10-01 19:50:39, End Time: 2013-10-01 21:43:26
      To: 15864, Order: 191781, Start Time: 2013-10-01 17:33:49, End Time: 2013-10-01 19:24:24
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 38 (52 on baseline)
Performance Improvements: 4 (21 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1065 (1034 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Stanford/Quicksort: 99.41% (0.0338 => 0.0674, std.dev.: 0.0062)
  SingleSource/Benchmarks/Misc/flops-1: 80.94% (0.0299 => 0.0541, std.dev.: 0.0034)
  SingleSource/Benchmarks/Stanford/Perm: 72.11% (0.0337 => 0.0580, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/ffbench: 71.99% (0.0789 => 0.1357, std.dev.: 0.0052)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 52.54% (0.0295 => 0.0450, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout-C++/strcat: 42.93% (0.2078 => 0.2970, std.dev.: 0.0254)
  SingleSource/Benchmarks/Misc/whetstone: 24.25% (0.0895 => 0.1112, std.dev.: 0.0047)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 15.44% (0.8357 => 0.9647, std.dev.: 0.0284)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.87% (1.2288 => 1.3869, std.dev.: 0.0346)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.98% (2.5964 => 2.8815, std.dev.: 0.0484)
  MultiSource/Benchmarks/nbench/nbench: 10.91% (1.2724 => 1.4112, std.dev.: 0.0519)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.87% (1.2782 => 1.4171, std.dev.: 0.0229)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.64% (1.2367 => 1.3683, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.58% (1.3081 => 1.4465, std.dev.: 0.0482)
  SingleSource/Benchmarks/Stanford/Puzzle: 10.47% (0.1299 => 0.1435, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.67% (1.3220 => 1.4499, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.63% (1.3152 => 1.4419, std.dev.: 0.0258)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.65% (0.6460 => 0.6954, std.dev.: 0.0078)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 7.00% (0.3974 => 0.4252, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.89% (1.2532 => 1.3395, std.dev.: 0.0250)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 6.69% (0.2212 => 0.2360, std.dev.: 0.0023)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Quicksort: 36.30% (0.0303 => 0.0413, std.dev.: 0.0006)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 30.21% (2.4881 => 3.2398, std.dev.: 0.0368)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.64% (0.4148 => 0.4631, std.dev.: 0.0163)
  MultiSource/Benchmarks/Bullet/bullet: 9.92% (7.1051 => 7.8100, std.dev.: 0.0456)
  SingleSource/Benchmarks/McGill/chomp: 9.27% (1.0280 => 1.1233, std.dev.: 0.0257)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.79% (1.2567 => 1.3546, std.dev.: 0.0245)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 7.59% (1.4895 => 1.6025, std.dev.: 0.0420)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (1.0111 => 1.0697, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.98% (5.9004 => 6.1945, std.dev.: 0.0315)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.66% (5.3815 => 5.6324, std.dev.: 0.0606)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.98% (39.3978 => 40.9646, std.dev.: 0.1847)
  MultiSource/Benchmarks/sim/sim: 3.03% (3.9441 => 4.0638, std.dev.: 0.0258)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.55% (5.0944 => 5.2242, std.dev.: 0.0290)
  SingleSource/Benchmarks/Misc/flops: 2.32% (9.3556 => 9.5724, std.dev.: 0.0301)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.26% (16.0963 => 16.4597, std.dev.: 0.1299)
  SingleSource/Benchmarks/Misc/oourafft: 1.57% (3.7286 => 3.7871, std.dev.: 0.0223)
  SingleSource/Benchmarks/Shootout-C++/matrix: 1.01% (2.8277 => 2.8564, std.dev.: 0.0080)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/moments: -7.62% (0.4528 => 0.4183, std.dev.: 0.0056)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.24% (3.7221 => 3.4898, std.dev.: 0.0126)
  SingleSource/Benchmarks/Shootout/sieve: -2.88% (7.2639 => 7.0544, std.dev.: 0.0431)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.06% (5.3804 => 5.3232, std.dev.: 0.0099)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.86% (0.1397 => 0.1371, std.dev.: 0.0378)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Stanford/Perm: 79.57% (0.0323 => 0.0580, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/flops-1: 78.55% (0.0303 => 0.0541, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/ffbench: 72.87% (0.0785 => 0.1357, std.dev.: 0.0052)
  SingleSource/Benchmarks/Stanford/Quicksort: 66.42% (0.0405 => 0.0674, std.dev.: 0.0062)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 52.54% (0.0295 => 0.0450, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout-C++/strcat: 46.96% (0.2021 => 0.2970, std.dev.: 0.0254)
  SingleSource/Benchmarks/Misc/whetstone: 27.23% (0.0874 => 0.1112, std.dev.: 0.0047)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.17% (0.8233 => 0.9647, std.dev.: 0.0284)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.68% (0.3345 => 0.3836, std.dev.: 0.0190)
  SingleSource/Benchmarks/Stanford/Puzzle: 14.25% (0.1256 => 0.1435, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.13% (1.2152 => 1.3869, std.dev.: 0.0346)
  MultiSource/Benchmarks/nbench/nbench: 13.04% (1.2484 => 1.4112, std.dev.: 0.0519)
  MultiSource/Benchmarks/PAQ8p/paq8p: 12.27% (2.5666 => 2.8815, std.dev.: 0.0484)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 12.15% (1.2201 => 1.3683, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.12% (1.2639 => 1.4171, std.dev.: 0.0229)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.72% (1.2948 => 1.4465, std.dev.: 0.0482)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 11.64% (0.2114 => 0.2360, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/moments: 10.93% (0.3771 => 0.4183, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.56% (1.3042 => 1.4419, std.dev.: 0.0258)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.3123 => 1.4499, std.dev.: 0.0186)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.43% (0.6297 => 0.6954, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.37% (1.3499 => 1.4899, std.dev.: 0.0504)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 8.08% (0.3934 => 0.4252, std.dev.: 0.0075)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.83% (0.1597 => 0.1722, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.12% (1.2622 => 1.3395, std.dev.: 0.0250)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.04% (1.2652 => 1.3416, std.dev.: 0.0266)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.93% (0.4624 => 0.4898, std.dev.: 0.0105)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.40% (0.2821 => 0.2945, std.dev.: 0.0043)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Bubblesort: 65.59% (0.0279 => 0.0462, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.59% (7.6426 => 12.5025, std.dev.: 0.1328)
  SingleSource/Benchmarks/Stanford/Quicksort: 52.40% (0.0271 => 0.0413, std.dev.: 0.0006)
  SingleSource/Benchmarks/Stanford/Perm: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 30.89% (2.4753 => 3.2398, std.dev.: 0.0368)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.41% (0.1374 => 0.1627, std.dev.: 0.0042)
  MultiSource/Benchmarks/Bullet/bullet: 11.04% (7.0333 => 7.8100, std.dev.: 0.0456)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.98% (4.9428 => 5.4854, std.dev.: 0.0304)
  SingleSource/Benchmarks/McGill/chomp: 10.55% (1.0161 => 1.1233, std.dev.: 0.0257)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.23% (1.2516 => 1.3546, std.dev.: 0.0245)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.06% (1.4830 => 1.6025, std.dev.: 0.0420)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 8.00% (2.3365 => 2.5234, std.dev.: 0.0654)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0020)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.27% (8.1346 => 8.6450, std.dev.: 0.0895)
  MultiSource/Benchmarks/sim/sim: 6.07% (3.8312 => 4.0638, std.dev.: 0.0258)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.88% (5.9061 => 6.1945, std.dev.: 0.0315)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.86% (5.3716 => 5.6324, std.dev.: 0.0606)
  MultiSource/Applications/siod/siod: 3.46% (3.5310 => 3.6532, std.dev.: 0.0259)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.3836 => 0.3956, std.dev.: 0.0012)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.53% (39.9519 => 40.9646, std.dev.: 0.1847)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.48% (5.0980 => 5.2242, std.dev.: 0.0290)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.11% (1.5940 => 1.6277, std.dev.: 0.0124)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.57% (16.7972 => 17.0602, std.dev.: 0.0086)
  SingleSource/Benchmarks/Misc/flops: 1.37% (9.4433 => 9.5724, std.dev.: 0.0301)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -19.82% (0.1483 => 0.1189, std.dev.: 0.0025)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.66% (0.5226 => 0.2317, std.dev.: 0.0265)
  MultiSource/Applications/sgefa/sgefa: -47.02% (1.5790 => 0.8365, std.dev.: 0.0368)
  SingleSource/Benchmarks/Linpack/linpack-pc: -29.20% (57.2347 => 40.5247, std.dev.: 5.3332)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.53% (15.9508 => 13.1540, std.dev.: 0.3078)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.08% (0.3304 => 0.2905, std.dev.: 0.0037)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.74% (20.8247 => 18.5890, std.dev.: 0.0753)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.66% (3.4956 => 3.1231, std.dev.: 0.0444)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.96% (50.0284 => 46.5441, std.dev.: 0.3617)
  MultiSource/Applications/JM/lencod/lencod: -4.58% (8.1785 => 7.8036, std.dev.: 0.1385)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.55% (3.0561 => 2.9169, std.dev.: 0.0495)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.96% (2.5938 => 2.4911, std.dev.: 0.0257)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.03% (2.4471 => 2.3729, std.dev.: 0.0225)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.91% (3.7437 => 3.6346, std.dev.: 0.0294)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.80% (4.3592 => 4.2372, std.dev.: 0.0391)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.75% (5.2422 => 5.0982, std.dev.: 0.0406)
  SingleSource/Benchmarks/Shootout/sieve: -2.37% (7.2254 => 7.0544, std.dev.: 0.0431)
  SingleSource/Benchmarks/Shootout/lists: -2.30% (7.3703 => 7.2009, std.dev.: 0.0425)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.09% (17.1431 => 16.7842, std.dev.: 0.0765)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.09% (3.5642 => 3.4898, std.dev.: 0.0126)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.18% (89.7126 => 88.6543, std.dev.: 0.2784)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.71% (0.1348 => 0.1371, std.dev.: 0.0378)

Report Time: 0.69s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131001/987c4bb6/attachment.html>


More information about the llvm-testresults mailing list