[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Oct 20 12:03:46 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16507?compare_to=16504&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16507, Order: 193049, Start Time: 2013-10-20 17:17:57, End Time: 2013-10-20 19:07:02
      To: 16504, Order: 193048, Start Time: 2013-10-20 14:43:53, End Time: 2013-10-20 16:24:53
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 29 (55 on baseline)
Performance Improvements: 9 (17 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1069 (1035 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: 76.35% (0.0296 => 0.0522, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/flops-1: 75.65% (0.0308 => 0.0541, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/flops: 39.96% (0.1116 => 0.1562, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 22.86% (0.8903 => 1.0938, std.dev.: 0.0060)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.64% (25.3377 => 29.0483, std.dev.: 0.3621)
  MultiSource/Benchmarks/Bullet/bullet: 13.86% (33.6113 => 38.2692, std.dev.: 1.6587)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 13.33% (6.1517 => 6.9719, std.dev.: 0.0344)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 11.38% (0.3314 => 0.3691, std.dev.: 0.0123)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.34% (0.5115 => 0.5644, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.87% (1.2180 => 1.3382, std.dev.: 0.0271)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.59% (0.8361 => 0.9079, std.dev.: 0.0066)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.2993 => 0.3212, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 6.99% (0.1574 => 0.1684, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 6.87% (0.2053 => 0.2194, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/random: 6.55% (0.2001 => 0.2132, std.dev.: 0.0049)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.03% (4.9778 => 5.0293, std.dev.: 0.0154)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 48.27% (4.5261 => 6.7109, std.dev.: 0.1222)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 23.22% (1.4442 => 1.7796, std.dev.: 0.1298)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.92% (2.1110 => 2.4049, std.dev.: 0.0040)
  MultiSource/Benchmarks/Bullet/bullet: 8.69% (7.0019 => 7.6104, std.dev.: 0.1001)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.56% (96.3633 => 104.6130, std.dev.: 1.0281)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.40% (1.0632 => 1.1419, std.dev.: 0.0148)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.10% (6.0840 => 6.5159, std.dev.: 0.0070)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.59% (2.6526 => 2.8273, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.83% (6.2934 => 6.5971, std.dev.: 0.0284)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.76% (4.0568 => 4.2095, std.dev.: 0.0186)
  SingleSource/Benchmarks/Misc/flops: 3.56% (9.2722 => 9.6022, std.dev.: 0.0615)
  SingleSource/Benchmarks/Misc/ffbench: 3.46% (1.4004 => 1.4488, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.04% (5.8868 => 6.0070, std.dev.: 0.0109)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: -13.46% (2.1126 => 1.8282, std.dev.: 0.0399)
  SingleSource/Benchmarks/Misc/fp-convert: -3.00% (7.8205 => 7.5859, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.88% (5.4359 => 5.2791, std.dev.: 0.0405)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.76% (0.3990 => 0.3880, std.dev.: 0.0040)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.16% (3.1873 => 3.1185, std.dev.: 0.0207)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.06% (6.8454 => 6.7047, std.dev.: 0.0018)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.76% (2.5332 => 2.4887, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.53% (12.1302 => 11.9450, std.dev.: 0.0178)
  SingleSource/Benchmarks/Shootout-C++/methcall: -1.40% (12.6367 => 12.4599, std.dev.: 0.0533)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.44% (0.1365 => 0.1412, std.dev.: 0.0236)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-1: 78.55% (0.0303 => 0.0541, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/fp-convert: 70.59% (0.0306 => 0.0522, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/flops: 51.06% (0.1034 => 0.1562, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.27% (0.8802 => 1.0938, std.dev.: 0.0060)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 19.65% (4.0397 => 4.8336, std.dev.: 0.2834)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 18.02% (24.6139 => 29.0483, std.dev.: 0.3621)
  MultiSource/Benchmarks/Bullet/bullet: 16.83% (32.7552 => 38.2692, std.dev.: 1.6587)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 15.65% (6.0284 => 6.9719, std.dev.: 0.0344)
  SingleSource/Benchmarks/Misc/oourafft: 15.39% (0.2294 => 0.2647, std.dev.: 0.0080)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 13.12% (0.3263 => 0.3691, std.dev.: 0.0123)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.85% (0.5046 => 0.5644, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.45% (1.2007 => 1.3382, std.dev.: 0.0271)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 10.31% (0.1989 => 0.2194, std.dev.: 0.0011)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.28% (0.8233 => 0.9079, std.dev.: 0.0066)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.66% (0.2956 => 0.3212, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 7.11% (0.1406 => 0.1506, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.13% (0.3096 => 0.3224, std.dev.: 0.0024)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.21% (1.5333 => 1.5825, std.dev.: 0.0127)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.89% (14.4764 => 14.8944, std.dev.: 0.0751)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.58% (1.3365 => 1.3710, std.dev.: 0.0064)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.18% (7.2661 => 7.4247, std.dev.: 0.0176)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.03% (4.9293 => 5.0293, std.dev.: 0.0154)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.68% (1.0952 => 1.1136, std.dev.: 0.0056)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.64% (1.4041 => 1.4271, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.56% (1.3498 => 1.3709, std.dev.: 0.0080)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.49% (4.9105 => 4.9837, std.dev.: 0.0204)
  MultiSource/Benchmarks/nbench/nbench: 1.38% (1.2484 => 1.2656, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.02% (1.2553 => 1.2681, std.dev.: 0.0014)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.03% (7.6426 => 12.4599, std.dev.: 0.0533)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 47.56% (4.5479 => 6.7109, std.dev.: 0.1222)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 22.18% (1.1431 => 1.3966, std.dev.: 0.0533)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.92% (2.1111 => 2.4049, std.dev.: 0.0040)
  MultiSource/Benchmarks/Bullet/bullet: 8.21% (7.0333 => 7.6104, std.dev.: 0.1001)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.09% (96.7834 => 104.6130, std.dev.: 1.0281)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (3.5550 => 3.8364, std.dev.: 0.0121)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.52% (2.4753 => 2.6615, std.dev.: 0.0187)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.66% (6.1088 => 6.5159, std.dev.: 0.0070)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0088)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.37% (2.6579 => 2.8273, std.dev.: 0.0188)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.37% (3.1730 => 3.3752, std.dev.: 0.0609)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.37% (2.3084 => 2.4554, std.dev.: 0.0370)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.74% (5.3716 => 5.6797, std.dev.: 0.0474)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.80% (0.8273 => 0.8670, std.dev.: 0.0117)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.69% (4.0596 => 4.2095, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.56% (4.4696 => 4.6285, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc/ffbench: 3.26% (1.4030 => 1.4488, std.dev.: 0.0070)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.15% (89.7126 => 92.5363, std.dev.: 0.4564)
  SingleSource/Regression/C/uint64_to_float: 2.42% (1.4528 => 1.4879, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.41% (5.4925 => 5.6247, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.34% (11.7654 => 12.0405, std.dev.: 0.0298)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.94% (5.3022 => 5.4048, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.69% (1.0477 => 1.0654, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/flops: 1.68% (9.4433 => 9.6022, std.dev.: 0.0615)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (1.6707 => 1.6949, std.dev.: 0.0050)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.16% (8.1346 => 8.2290, std.dev.: 0.0212)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -19.89% (0.1483 => 0.1188, std.dev.: 0.0036)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.04% (0.5226 => 0.2402, std.dev.: 0.0703)
  MultiSource/Applications/sgefa/sgefa: -42.79% (1.5790 => 0.9033, std.dev.: 0.0070)
  SingleSource/Benchmarks/Linpack/linpack-pc: -34.04% (57.2347 => 37.7492, std.dev.: 5.7679)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.75% (0.0400 => 0.0273, std.dev.: 0.0000)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.10% (15.9508 => 12.9039, std.dev.: 0.2190)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.18% (50.0284 => 40.9316, std.dev.: 2.6903)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.79% (3.4956 => 3.1185, std.dev.: 0.0207)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.06% (20.8247 => 18.7288, std.dev.: 0.0560)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.05% (2.5938 => 2.4887, std.dev.: 0.0117)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.17% (3.7437 => 3.6252, std.dev.: 0.0376)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.09% (5.4473 => 5.2791, std.dev.: 0.0405)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.77% (3.7874 => 3.6825, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.44% (17.1431 => 16.7243, std.dev.: 0.0620)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.34% (2.4471 => 2.3898, std.dev.: 0.0152)
  SingleSource/Benchmarks/Misc/whetstone: -1.18% (3.6303 => 3.5876, std.dev.: 0.0076)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (4.9459 => 4.8934, std.dev.: 0.0119)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.75% (0.1348 => 0.1412, std.dev.: 0.0236)

Report Time: 0.82s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131020/17fa497b/attachment.html>


More information about the llvm-testresults mailing list