[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Oct 16 19:06:16 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16388?compare_to=16384&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16388, Order: 192855, Start Time: 2013-10-17 00:21:14, End Time: 2013-10-17 02:09:26
      To: 16384, Order: 192852, Start Time: 2013-10-16 22:07:31, End Time: 2013-10-16 23:57:03
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 13 (19 on baseline)
Performance Improvements: 24 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1070 (1070 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/flops: 15.26% (8.0445 => 9.2718, std.dev.: 0.1699)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.15% (3.5329 => 3.6443, std.dev.: 0.0365)
  MultiSource/Applications/siod/siod: 2.88% (3.4999 => 3.6007, std.dev.: 0.0055)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.46% (1.8248 => 1.8696, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.09% (4.4898 => 4.5837, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.02% (6.5616 => 6.6943, std.dev.: 0.0036)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.02% (18.1058 => 18.4709, std.dev.: 0.0915)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.96% (5.5445 => 5.6531, std.dev.: 0.0205)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.31% (11.9353 => 12.0917, std.dev.: 0.0305)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.24% (2.5145 => 2.5458, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.23% (5.9482 => 6.0211, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.22% (3.1584 => 3.1968, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.19% (5.9094 => 5.9796, std.dev.: 0.0168)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -40.07% (0.0569 => 0.0341, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.11% (0.2360 => 0.1437, std.dev.: 0.0114)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -37.29% (0.0480 => 0.0301, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/ary2: -30.10% (0.3655 => 0.2555, std.dev.: 0.0158)
  SingleSource/Benchmarks/Misc/salsa20: -16.40% (0.0622 => 0.0520, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -15.43% (0.0985 => 0.0833, std.dev.: 0.0059)
  SingleSource/Benchmarks/Misc/flops: -14.70% (0.1313 => 0.1120, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.97% (7.0031 => 6.1645, std.dev.: 0.0721)
  SingleSource/Benchmarks/Misc/whetstone: -10.99% (0.1010 => 0.0899, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.01% (0.9898 => 0.9006, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -7.18% (0.2313 => 0.2147, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc-C++/bigfib: -6.46% (0.7126 => 0.6666, std.dev.: 0.0043)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -32.68% (6.8200 => 4.5911, std.dev.: 0.3019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -14.06% (47.5641 => 40.8750, std.dev.: 0.7595)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.14% (0.1035 => 0.0899, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc/salsa20: -8.10% (8.1601 => 7.4989, std.dev.: 0.0206)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.40% (44.0507 => 40.7903, std.dev.: 0.4859)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.96% (6.5391 => 6.0842, std.dev.: 0.1739)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -5.87% (2.8222 => 2.6566, std.dev.: 0.0351)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.91% (0.7455 => 0.7089, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.46% (6.1135 => 5.9019, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.25% (5.0905 => 5.0268, std.dev.: 0.0189)
  SingleSource/Benchmarks/Misc/dt: -1.06% (0.9903 => 0.9798, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.05% (3.3832 => 3.3478, std.dev.: 0.0080)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.74% (0.1364 => 0.1313, std.dev.: 0.0230)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/mason/mason: 16.02% (0.0643 => 0.0746, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.6439 => 0.6666, std.dev.: 0.0043)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.89% (0.6297 => 0.6479, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.42% (1.2695 => 1.3002, std.dev.: 0.0111)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.32% (0.8802 => 0.9006, std.dev.: 0.0068)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.53% (7.6426 => 12.4976, std.dev.: 0.0753)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 23.02% (1.1431 => 1.4062, std.dev.: 0.0430)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.51% (3.1730 => 3.3478, std.dev.: 0.0080)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.24% (5.3716 => 5.6531, std.dev.: 0.0205)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.22% (89.7126 => 92.6005, std.dev.: 0.3582)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.84% (2.5368 => 2.6089, std.dev.: 0.0137)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.55% (4.4696 => 4.5837, std.dev.: 0.0188)
  MultiSource/Applications/siod/siod: 1.97% (3.5310 => 3.6007, std.dev.: 0.0055)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.77% (8.1346 => 8.2786, std.dev.: 0.0294)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.39% (6.6028 => 6.6943, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.37% (11.9288 => 12.0917, std.dev.: 0.0305)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.26% (3.1569 => 3.1968, std.dev.: 0.0102)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.16% (16.7972 => 16.9921, std.dev.: 0.0335)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -56.12% (0.5226 => 0.2293, std.dev.: 0.0125)
  MultiSource/Applications/sgefa/sgefa: -42.63% (1.5790 => 0.9058, std.dev.: 0.0067)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.00% (0.0400 => 0.0276, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/em3d/em3d: -29.26% (5.0288 => 3.5573, std.dev.: 0.0116)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.16% (57.2347 => 43.9818, std.dev.: 3.4553)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.59% (15.9508 => 12.9852, std.dev.: 0.3952)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.47% (50.0284 => 40.7903, std.dev.: 0.4859)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.30% (20.8247 => 18.4709, std.dev.: 0.0915)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.84% (0.3304 => 0.2979, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.58% (3.4956 => 3.1606, std.dev.: 0.0141)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.15% (0.7474 => 0.7089, std.dev.: 0.0135)
  SingleSource/Benchmarks/Misc/salsa20: -3.82% (7.7964 => 7.4989, std.dev.: 0.0206)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.06% (3.7437 => 3.6292, std.dev.: 0.0329)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.49% (3.7874 => 3.6931, std.dev.: 0.0047)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.45% (4.3592 => 4.2526, std.dev.: 0.0271)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.85% (2.5938 => 2.5458, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.74% (17.1431 => 16.8444, std.dev.: 0.0210)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.63% (4.9459 => 4.8652, std.dev.: 0.0081)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.60% (0.1348 => 0.1313, std.dev.: 0.0230)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131016/9c1ff283/attachment.html>


More information about the llvm-testresults mailing list