[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 28 12:27:43 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16774?compare_to=16771&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16774, Order: 193523, Start Time: 2013-10-28 17:37:29, End Time: 2013-10-28 19:31:08
      To: 16771, Order: 193521, Start Time: 2013-10-28 15:27:02, End Time: 2013-10-28 17:08:27
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 36 (47 on baseline)
Performance Improvements: 5 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1044 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: 79.91% (0.0697 => 0.1254, std.dev.: 0.0095)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 74.63% (0.2207 => 0.3854, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.64% (1.2859 => 1.5385, std.dev.: 0.0323)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 17.94% (1.2507 => 1.4751, std.dev.: 0.0659)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.16% (1.3377 => 1.5673, std.dev.: 0.0352)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 16.63% (1.2658 => 1.4763, std.dev.: 0.0777)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.56% (1.2105 => 1.4109, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 16.49% (1.3018 => 1.5165, std.dev.: 0.0616)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 15.95% (1.3566 => 1.5730, std.dev.: 0.0516)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 15.88% (1.2282 => 1.4232, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.56% (1.3366 => 1.5446, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.33% (1.2482 => 1.4395, std.dev.: 0.0432)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 15.13% (1.2686 => 1.4606, std.dev.: 0.0520)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.96% (1.3084 => 1.5041, std.dev.: 0.0259)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.93% (1.4713 => 1.6910, std.dev.: 0.0286)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.22% (1.3542 => 1.5468, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.77% (1.2226 => 1.3910, std.dev.: 0.0303)
  MultiSource/Benchmarks/PAQ8p/paq8p: 12.86% (2.5606 => 2.8898, std.dev.: 0.0968)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.22% (1.2848 => 1.4290, std.dev.: 0.0353)
  MultiSource/Benchmarks/Bullet/bullet: 10.62% (33.4718 => 37.0268, std.dev.: 1.0220)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.22% (98.1332 => 106.1957, std.dev.: 1.2023)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.92% (4.1014 => 4.3853, std.dev.: 0.0666)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.67% (12.9185 => 13.7799, std.dev.: 0.1713)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.43% (4.5730 => 4.8214, std.dev.: 0.0382)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.31% (5.9024 => 6.2159, std.dev.: 0.1194)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.39% (3.5598 => 3.7161, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.87% (5.0885 => 5.2855, std.dev.: 0.0444)
  SingleSource/Benchmarks/Shootout-C++/lists: 3.38% (15.7563 => 16.2896, std.dev.: 0.1027)
  SingleSource/Benchmarks/Shootout-C++/ary3: 3.09% (4.6347 => 4.7778, std.dev.: 0.0369)
  MultiSource/Benchmarks/sim/sim: 2.68% (3.9594 => 4.0654, std.dev.: 0.0398)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.30% (5.7897 => 5.9229, std.dev.: 0.0471)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.63% (8.9008 => 9.0458, std.dev.: 0.0563)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.61% (4.9543 => 5.0343, std.dev.: 0.0165)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.53% (3.5856 => 3.6405, std.dev.: 0.0170)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.09% (5.8782 => 5.9423, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.02% (4.9731 => 5.0237, std.dev.: 0.0007)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: -16.14% (5.4495 => 4.5701, std.dev.: 0.2179)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.69% (7.5708 => 6.4586, std.dev.: 0.2258)
  MultiSource/Benchmarks/nbench/nbench: -13.21% (23.5459 => 20.4347, std.dev.: 0.5972)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.08% (4.1445 => 4.0170, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.39% (4.6234 => 4.5130, std.dev.: 0.0039)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.66% (0.1366 => 0.1375, std.dev.: 0.0325)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: 79.14% (0.0700 => 0.1254, std.dev.: 0.0095)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 72.90% (0.2229 => 0.3854, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 25.50% (1.2523 => 1.5716, std.dev.: 0.1214)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.06% (1.2494 => 1.4751, std.dev.: 0.0659)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.82% (1.3303 => 1.5673, std.dev.: 0.0352)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 17.73% (1.3068 => 1.5385, std.dev.: 0.0323)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 17.63% (1.2550 => 1.4763, std.dev.: 0.0777)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.51% (1.2007 => 1.4109, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 17.12% (1.2948 => 1.5165, std.dev.: 0.0616)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.54% (1.3498 => 1.5730, std.dev.: 0.0516)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 16.33% (1.3278 => 1.5446, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 15.83% (1.4599 => 1.6910, std.dev.: 0.0286)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 15.44% (1.2652 => 1.4606, std.dev.: 0.0520)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 15.33% (1.3042 => 1.5041, std.dev.: 0.0259)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.47% (1.2152 => 1.3910, std.dev.: 0.0303)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.46% (1.3514 => 1.5468, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.05% (1.2622 => 1.4395, std.dev.: 0.0432)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 13.87% (1.2499 => 1.4232, std.dev.: 0.0011)
  MultiSource/Benchmarks/Bullet/bullet: 13.04% (32.7552 => 37.0268, std.dev.: 1.0220)
  MultiSource/Benchmarks/PAQ8p/paq8p: 12.59% (2.5666 => 2.8898, std.dev.: 0.0968)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 12.56% (1.2695 => 1.4290, std.dev.: 0.0353)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.02% (1.4033 => 1.4457, std.dev.: 0.0074)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.92% (7.6426 => 12.2987, std.dev.: 0.0566)
  SingleSource/Benchmarks/Shootout-C++/matrix: 45.98% (2.8554 => 4.1683, std.dev.: 0.0581)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 30.57% (1.1431 => 1.4926, std.dev.: 0.0073)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.62% (2.4753 => 2.7629, std.dev.: 0.0783)
  MultiSource/Benchmarks/PAQ8p/paq8p: 9.73% (96.7834 => 106.1957, std.dev.: 1.2023)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.93% (4.1011 => 4.3853, std.dev.: 0.0666)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0002)
  MultiSource/Benchmarks/sim/sim: 6.11% (3.8312 => 4.0654, std.dev.: 0.0398)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.40% (4.5744 => 4.8214, std.dev.: 0.0382)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.25% (3.1730 => 3.3395, std.dev.: 0.0547)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.25% (5.9061 => 6.2159, std.dev.: 0.1194)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.41% (3.5590 => 3.7161, std.dev.: 0.0175)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (0.2842 => 0.2957, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.68% (5.0980 => 5.2855, std.dev.: 0.0444)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.28% (89.7126 => 92.6551, std.dev.: 0.5237)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.44% (0.4549 => 0.4660, std.dev.: 0.0012)
  MultiSource/Benchmarks/Olden/power/power: 2.40% (1.2170 => 1.2462, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.32% (5.7884 => 5.9229, std.dev.: 0.0471)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.10% (1.0477 => 1.0697, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.02% (3.5683 => 3.6405, std.dev.: 0.0170)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.87% (8.8798 => 9.0458, std.dev.: 0.0563)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.57% (4.9459 => 5.0237, std.dev.: 0.0007)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.50% (16.7972 => 17.0495, std.dev.: 0.0201)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.47% (1.6707 => 1.6952, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.11% (5.8769 => 5.9423, std.dev.: 0.0055)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.51% (0.1483 => 0.1164, std.dev.: 0.0093)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.46% (0.5226 => 0.2380, std.dev.: 0.0232)
  MultiSource/Applications/sgefa/sgefa: -42.39% (1.5790 => 0.9096, std.dev.: 0.0025)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.25% (0.0400 => 0.0271, std.dev.: 0.0007)
  SingleSource/Benchmarks/Linpack/linpack-pc: -24.69% (57.2347 => 43.1038, std.dev.: 4.6360)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.99% (50.0284 => 43.0319, std.dev.: 1.0092)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.61% (15.9508 => 13.7799, std.dev.: 0.1713)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.45% (20.8247 => 18.4396, std.dev.: 0.1768)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.10% (3.4956 => 3.1424, std.dev.: 0.0204)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.90% (3.7437 => 3.4481, std.dev.: 0.0110)
  MultiSource/Benchmarks/nbench/nbench: -7.65% (22.1263 => 20.4347, std.dev.: 0.5972)
  SingleSource/Benchmarks/Shootout-C++/ary3: -4.45% (5.0002 => 4.7778, std.dev.: 0.0369)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.31% (2.5938 => 2.4819, std.dev.: 0.0217)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.16% (3.7874 => 3.6677, std.dev.: 0.0290)
  SingleSource/Benchmarks/Misc/oourafft: -2.44% (3.7484 => 3.6569, std.dev.: 0.0327)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.66% (4.3592 => 4.2867, std.dev.: 0.0101)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.00% (0.1348 => 0.1375, std.dev.: 0.0325)

Report Time: 1.04s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131028/9333d6a0/attachment.html>


More information about the llvm-testresults mailing list