[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 7 11:16:41 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16075?compare_to=16071&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16075, Order: 192104, Start Time: 2013-10-07 16:28:19, End Time: 2013-10-07 18:19:42
      To: 16071, Order: 192100, Start Time: 2013-10-07 14:15:59, End Time: 2013-10-07 16:02:44
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 32 (36 on baseline)
Performance Improvements: 7 (11 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1068 (1060 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: 74.49% (0.0294 => 0.0513, std.dev.: 0.0041)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 67.96% (0.0540 => 0.0907, std.dev.: 0.0142)
  SingleSource/Benchmarks/Stanford/RealMM: 52.83% (0.0441 => 0.0674, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/flops: 49.12% (0.1079 => 0.1609, std.dev.: 0.0205)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 34.77% (0.2980 => 0.4016, std.dev.: 0.0245)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 16.38% (2.7333 => 3.1810, std.dev.: 0.0085)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.18% (0.8344 => 0.9360, std.dev.: 0.0333)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 11.20% (6.1066 => 6.7904, std.dev.: 0.1387)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.22% (0.8965 => 0.9881, std.dev.: 0.0165)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 9.81% (0.2080 => 0.2284, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/wc: 8.67% (0.2191 => 0.2381, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 8.26% (0.3524 => 0.3815, std.dev.: 0.0087)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.74% (0.2146 => 0.2312, std.dev.: 0.0048)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 55.84% (2.8196 => 4.3941, std.dev.: 0.2106)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 47.36% (4.4821 => 6.6047, std.dev.: 0.2565)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 14.59% (3.7211 => 4.2640, std.dev.: 0.1099)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.08% (2.1110 => 2.4082, std.dev.: 0.0123)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 11.62% (2.2700 => 2.5338, std.dev.: 0.0266)
  SingleSource/Benchmarks/McGill/chomp: 10.27% (1.0311 => 1.1370, std.dev.: 0.0268)
  SingleSource/Benchmarks/Misc/salsa20: 9.59% (7.4872 => 8.2049, std.dev.: 0.0069)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 9.27% (0.4640 => 0.5070, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.23% (5.9555 => 6.4459, std.dev.: 0.0350)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 6.99% (6.5161 => 6.9714, std.dev.: 0.0119)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 6.02% (3.6397 => 3.8588, std.dev.: 0.0114)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.37% (3.9756 => 4.1493, std.dev.: 0.0454)
  MultiSource/Applications/aha/aha: 3.58% (3.5949 => 3.7235, std.dev.: 0.0304)
  SingleSource/Benchmarks/Misc/flops: 2.54% (9.3518 => 9.5889, std.dev.: 0.0591)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.96% (5.5066 => 5.6146, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.80% (6.5361 => 6.6536, std.dev.: 0.0394)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.60% (2.5496 => 2.5905, std.dev.: 0.0130)
  SingleSource/Benchmarks/Misc/mandel-2: 1.51% (0.8399 => 0.8526, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/fbench: 1.24% (4.9213 => 4.9823, std.dev.: 0.0149)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -27.97% (3.9500 => 2.8451, std.dev.: 0.1572)
  SingleSource/Benchmarks/Misc/ReedSolomon: -5.20% (8.9585 => 8.4930, std.dev.: 0.1433)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.09% (2.6177 => 2.5368, std.dev.: 0.0061)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.64% (6.8216 => 6.7100, std.dev.: 0.0187)
  MultiSource/Applications/viterbi/viterbi: -1.30% (2.6985 => 2.6634, std.dev.: 0.0132)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.23% (4.5563 => 4.5004, std.dev.: 0.0143)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.06% (1.0584 => 1.0472, std.dev.: 0.0008)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.15% (0.1352 => 0.1350, std.dev.: 0.0300)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: 67.65% (0.0306 => 0.0513, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/flops: 55.61% (0.1034 => 0.1609, std.dev.: 0.0205)
  SingleSource/Benchmarks/Stanford/RealMM: 49.78% (0.0450 => 0.0674, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 35.86% (0.2956 => 0.4016, std.dev.: 0.0245)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.07% (2.6492 => 3.1810, std.dev.: 0.0085)
  SingleSource/Benchmarks/Linpack/linpack-pc: 15.84% (0.2949 => 0.3416, std.dev.: 0.0065)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.69% (0.8233 => 0.9360, std.dev.: 0.0333)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 12.64% (6.0284 => 6.7904, std.dev.: 0.1387)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.26% (0.8802 => 0.9881, std.dev.: 0.0165)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.74% (0.2069 => 0.2312, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 7.58% (0.2123 => 0.2284, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/wc: 7.06% (0.2224 => 0.2381, std.dev.: 0.0039)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Queens: 67.22% (0.0241 => 0.0403, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.07% (7.6426 => 12.4628, std.dev.: 0.0193)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 45.93% (3.0111 => 4.3941, std.dev.: 0.2106)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 45.23% (4.5479 => 6.6047, std.dev.: 0.2565)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.07% (2.1111 => 2.4082, std.dev.: 0.0123)
  SingleSource/Benchmarks/McGill/chomp: 11.90% (1.0161 => 1.1370, std.dev.: 0.0268)
  SingleSource/Benchmarks/McGill/misr: 9.55% (0.3771 => 0.4131, std.dev.: 0.0080)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.3365 => 2.5338, std.dev.: 0.0266)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0081)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.33% (8.1346 => 8.6494, std.dev.: 0.0468)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 6.01% (3.6401 => 3.8588, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.64% (6.5990 => 6.9714, std.dev.: 0.0119)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.52% (6.1088 => 6.4459, std.dev.: 0.0350)
  SingleSource/Benchmarks/Misc/salsa20: 5.24% (7.7964 => 8.2049, std.dev.: 0.0069)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.54% (3.9691 => 4.1493, std.dev.: 0.0454)
  MultiSource/Applications/aha/aha: 4.21% (3.5731 => 3.7235, std.dev.: 0.0304)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.3836 => 0.3954, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.22% (5.4925 => 5.6146, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.76% (3.1569 => 3.2126, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.54% (2.5513 => 2.5905, std.dev.: 0.0130)
  SingleSource/Benchmarks/Misc/mandel-2: 1.51% (0.8399 => 0.8526, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout/fib2: 1.19% (3.5966 => 3.6394, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.18% (5.3022 => 5.3646, std.dev.: 0.0193)
  SingleSource/Benchmarks/Misc/dt: 1.06% (0.9773 => 0.9877, std.dev.: 0.0005)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.23% (0.1483 => 0.1183, std.dev.: 0.0059)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/sgefa/sgefa: -47.11% (1.5790 => 0.8352, std.dev.: 0.0355)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.03% (15.9508 => 12.9151, std.dev.: 0.5159)
  SingleSource/Benchmarks/Linpack/linpack-pc: -14.61% (57.2347 => 48.8731, std.dev.: 2.1585)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.59% (20.8247 => 18.4106, std.dev.: 0.2055)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.34% (50.0284 => 45.8567, std.dev.: 0.3210)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.65% (2.5938 => 2.4992, std.dev.: 0.0210)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.63% (4.3592 => 4.2009, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.39% (5.4473 => 5.2624, std.dev.: 0.0707)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.82% (17.1431 => 16.6592, std.dev.: 0.0940)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.41% (89.7126 => 88.4484, std.dev.: 0.1714)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.15% (0.1348 => 0.1350, std.dev.: 0.0300)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131007/fb3ad858/attachment.html>


More information about the llvm-testresults mailing list