[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Oct 25 22:50:31 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16691?compare_to=16688&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16691, Order: 193459, Start Time: 2013-10-26 04:06:41, End Time: 2013-10-26 05:53:53
      To: 16688, Order: 193453, Start Time: 2013-10-26 01:48:16, End Time: 2013-10-26 03:40:53
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 29 (50 on baseline)
Performance Improvements: 12 (20 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1037 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.48% (0.8227 => 0.8431, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.21% (1.2131 => 1.2399, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.99% (1.2703 => 1.2956, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.98% (1.2191 => 1.2432, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.30% (1.2555 => 1.2718, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.28% (1.3662 => 1.3837, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.05% (1.4412 => 1.4563, std.dev.: 0.0046)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 22.19% (6.3072 => 7.7065, std.dev.: 0.1606)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 10.17% (0.4532 => 0.4993, std.dev.: 0.0038)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.95% (0.4278 => 0.4661, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.79% (3.5831 => 3.8623, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.26% (3.5335 => 3.7194, std.dev.: 0.0024)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.00% (1.8064 => 1.8967, std.dev.: 0.0026)
  SingleSource/Regression/C/uint64_to_float: 4.60% (1.4184 => 1.4836, std.dev.: 0.0007)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.92% (1.0371 => 1.0778, std.dev.: 0.0131)
  MultiSource/Applications/aha/aha: 3.30% (3.6610 => 3.7817, std.dev.: 0.0026)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.07% (2.4730 => 2.5490, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.58% (5.8546 => 6.0056, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.36% (5.3121 => 5.4373, std.dev.: 0.0017)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.13% (3.1241 => 3.1906, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.09% (3.9101 => 3.9917, std.dev.: 0.0035)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 1.99% (2.2855 => 2.3310, std.dev.: 0.0118)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.72% (2.4851 => 2.5279, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.62% (4.0804 => 4.1466, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.54% (5.3249 => 5.4068, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.33% (5.9494 => 6.0288, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.29% (3.5418 => 3.5875, std.dev.: 0.0010)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.20% (1.7833 => 1.8047, std.dev.: 0.0027)
  MultiSource/Applications/viterbi/viterbi: 1.18% (2.6553 => 2.6867, std.dev.: 0.0061)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2005-05-13-SDivTwo: -37.73% (0.0273 => 0.0170, std.dev.: 0.0017)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -20.35% (0.4997 => 0.3980, std.dev.: 0.0203)
  MultiSource/Benchmarks/Bullet/bullet: -16.99% (40.3217 => 33.4726, std.dev.: 1.7248)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -12.48% (1.4031 => 1.2280, std.dev.: 0.0053)
  SingleSource/Benchmarks/CoyoteBench/almabench: -12.00% (0.0900 => 0.0792, std.dev.: 0.0027)
  MultiSource/Benchmarks/PAQ8p/paq8p: -3.75% (2.6412 => 2.5421, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.68% (1.3667 => 1.3164, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.70% (1.3681 => 1.3449, std.dev.: 0.0042)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: -12.85% (8.0550 => 7.0199, std.dev.: 0.3563)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.50% (6.4085 => 6.1841, std.dev.: 0.0036)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.18% (0.5437 => 0.5264, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.70% (1.3146 => 1.2922, std.dev.: 0.0028)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.80% (0.1335 => 0.1359, std.dev.: 0.0071)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/08-main/main: 10.03% (0.2870 => 0.3158, std.dev.: 0.0091)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.49% (4.0397 => 4.3827, std.dev.: 0.0518)
  MultiSource/Applications/siod/siod: 4.06% (2.4480 => 2.5474, std.dev.: 0.0302)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.53% (1.3365 => 1.3837, std.dev.: 0.0062)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.91% (0.6297 => 0.6480, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.68% (1.2932 => 1.3279, std.dev.: 0.0117)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.40% (0.8233 => 0.8431, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.36% (1.3499 => 1.3818, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.06% (1.2695 => 1.2956, std.dev.: 0.0092)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.96% (7.2661 => 7.4087, std.dev.: 0.0231)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.95% (4.6423 => 4.7327, std.dev.: 0.0344)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.81% (1.4304 => 1.4563, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.67% (1.2948 => 1.3164, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.62% (1.3235 => 1.3449, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.35% (1.2116 => 1.2280, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.31% (1.2553 => 1.2718, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.06% (1.2494 => 1.2627, std.dev.: 0.0049)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 59.86% (7.6426 => 12.2177, std.dev.: 0.0772)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.23% (2.8554 => 4.2327, std.dev.: 0.0300)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 22.36% (1.1431 => 1.3987, std.dev.: 0.0530)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.62% (6.4425 => 7.7065, std.dev.: 0.1606)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.59% (2.4753 => 2.7126, std.dev.: 0.0301)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 9.42% (23.4704 => 25.6818, std.dev.: 0.0405)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.64% (3.5550 => 3.8623, std.dev.: 0.0186)
  MultiSource/Benchmarks/nbench/nbench: 5.88% (22.1263 => 23.4278, std.dev.: 0.3539)
  MultiSource/Applications/aha/aha: 5.84% (3.5731 => 3.7817, std.dev.: 0.0026)
  SingleSource/UnitTests/Vector/multiplies: 5.38% (0.5561 => 0.5860, std.dev.: 0.0047)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.23% (3.1730 => 3.3391, std.dev.: 0.0102)
  MultiSource/Benchmarks/sim/sim: 4.65% (3.8312 => 4.0092, std.dev.: 0.0421)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.35% (3.5642 => 3.7194, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.98% (5.7757 => 6.0056, std.dev.: 0.0019)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.55% (5.3716 => 5.5621, std.dev.: 0.0574)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.32% (2.5368 => 2.6211, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.20% (4.0181 => 4.1466, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.84% (0.3836 => 0.3945, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.49% (3.5683 => 3.6573, std.dev.: 0.0063)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.46% (0.4549 => 0.4661, std.dev.: 0.0006)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.42% (1.8519 => 1.8967, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.40% (5.4925 => 5.6243, std.dev.: 0.0020)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.31% (2.4920 => 2.5495, std.dev.: 0.0083)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.24% (1.7652 => 1.8047, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.12% (1.5940 => 1.6278, std.dev.: 0.0047)
  SingleSource/Regression/C/uint64_to_float: 2.12% (1.4528 => 1.4836, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.11% (1.0477 => 1.0698, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.01% (3.1569 => 3.2203, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.97% (5.3022 => 5.4068, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout/fib2: 1.64% (3.5966 => 3.6557, std.dev.: 0.0034)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (1.6707 => 1.6950, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.45% (6.6028 => 6.6985, std.dev.: 0.0120)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.23% (6.1088 => 6.1841, std.dev.: 0.0036)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.58% (0.1483 => 0.1163, std.dev.: 0.0012)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.61% (0.2193 => 0.2092, std.dev.: 0.0024)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -52.54% (0.5226 => 0.2480, std.dev.: 0.0004)
  MultiSource/Applications/sgefa/sgefa: -42.48% (1.5790 => 0.9083, std.dev.: 0.0031)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -38.25% (0.0400 => 0.0247, std.dev.: 0.0000)
  MultiSource/Benchmarks/FreeBench/mason/mason: -17.98% (0.3304 => 0.2710, std.dev.: 0.0215)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.78% (15.9508 => 13.1146, std.dev.: 0.2474)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.77% (57.2347 => 47.0658, std.dev.: 2.2491)
  MultiSource/Applications/SIBsim4/SIBsim4: -12.09% (3.7437 => 3.2912, std.dev.: 0.0970)
  MultiSource/Benchmarks/mafft/pairlocalalign: -12.05% (50.0284 => 43.9999, std.dev.: 0.3161)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.02% (20.8247 => 18.7379, std.dev.: 0.4783)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.73% (3.4956 => 3.1906, std.dev.: 0.0006)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.00% (8.1346 => 7.6466, std.dev.: 0.0721)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.34% (0.7474 => 0.7075, std.dev.: 0.0120)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.55% (3.7874 => 3.6909, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.54% (2.5938 => 2.5279, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/oourafft: -2.35% (3.7484 => 3.6602, std.dev.: 0.0329)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.11% (17.1431 => 16.7821, std.dev.: 0.0202)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.91% (4.3592 => 4.2759, std.dev.: 0.0143)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.56% (2.4471 => 2.4089, std.dev.: 0.0076)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.82% (0.1348 => 0.1359, std.dev.: 0.0071)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131026/c7da799e/attachment.html>


More information about the llvm-testresults mailing list