[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue May 28 14:34:59 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11814?compare_to=11810&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11814, Order: 182796, Start Time: 2013-05-28 19:45:42, End Time: 2013-05-28 21:35:31
      To: 11810, Order: 182777, Start Time: 2013-05-28 17:30:42, End Time: 2013-05-28 19:19:08
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 44 (35 on baseline)
Performance Improvements: 12 (22 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1051 (1050 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-10-12-StructureArgs: 63.22% (0.0174 => 0.0284, std.dev.: 0.0019)
  SingleSource/UnitTests/Threads/tls: 62.50% (0.0232 => 0.0377, std.dev.: 0.0015)
  SingleSource/UnitTests/SignlessTypes/factor: 61.78% (0.0348 => 0.0563, std.dev.: 0.0018)
  SingleSource/UnitTests/Vector/simple: 61.44% (0.0236 => 0.0381, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/build2: 60.86% (0.0373 => 0.0600, std.dev.: 0.0012)
  SingleSource/UnitTests/2002-05-02-ManyArguments: 58.52% (0.0176 => 0.0279, std.dev.: 0.0009)
  SingleSource/UnitTests/2003-04-22-Switch: 57.92% (0.0183 => 0.0289, std.dev.: 0.0032)
  SingleSource/UnitTests/2007-01-04-KNR-Args: 56.84% (0.0190 => 0.0298, std.dev.: 0.0018)
  SingleSource/UnitTests/2003-05-07-VarArgs: 53.93% (0.0267 => 0.0411, std.dev.: 0.0010)
  SingleSource/UnitTests/Vector/sumarray: 53.18% (0.0220 => 0.0337, std.dev.: 0.0011)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: 52.47% (0.0223 => 0.0340, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/multiplies: 51.34% (0.0335 => 0.0507, std.dev.: 0.0026)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 49.16% (0.0238 => 0.0355, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 48.09% (0.0759 => 0.1124, std.dev.: 0.0041)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 45.03% (0.1479 => 0.2145, std.dev.: 0.0111)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 28.90% (0.0391 => 0.0504, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 21.23% (0.1785 => 0.2164, std.dev.: 0.0126)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 19.80% (0.1768 => 0.2118, std.dev.: 0.0122)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.71% (2.6105 => 2.8379, std.dev.: 0.0202)
  SingleSource/Benchmarks/Shootout-C++/moments: 7.87% (0.4013 => 0.4329, std.dev.: 0.0008)
  MultiSource/Applications/ClamAV/clamscan: 6.58% (17.0046 => 18.1238, std.dev.: 0.1621)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.62% (4.1756 => 4.4103, std.dev.: 0.0895)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 4.58% (0.5499 => 0.5751, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.91% (1.5694 => 1.5993, std.dev.: 0.0105)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 28.50% (2.9501 => 3.7910, std.dev.: 0.2749)
  SingleSource/Benchmarks/Shootout-C++/ary: 18.74% (0.0635 => 0.0754, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.46% (3.5509 => 4.2064, std.dev.: 0.0106)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.31% (4.1213 => 4.8348, std.dev.: 0.0137)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 17.05% (9.0634 => 10.6091, std.dev.: 0.0646)
  SingleSource/Benchmarks/Shootout/heapsort: 16.85% (2.8874 => 3.3740, std.dev.: 0.1829)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.86% (29.6800 => 34.3858, std.dev.: 0.3696)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.51% (37.0566 => 42.4341, std.dev.: 0.8900)
  SingleSource/Benchmarks/Misc/flops-7: 11.87% (1.7328 => 1.9384, std.dev.: 0.0582)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.56% (15.3459 => 16.9663, std.dev.: 0.1542)
  MultiSource/Benchmarks/Bullet/bullet: 7.19% (6.9864 => 7.4889, std.dev.: 0.0141)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.89% (3.0182 => 3.1961, std.dev.: 0.0365)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.03% (3.9874 => 4.1880, std.dev.: 0.0747)
  SingleSource/Benchmarks/Misc/ffbench: 4.26% (1.3771 => 1.4358, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.12% (61.6340 => 64.1742, std.dev.: 0.8647)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.10% (4.7282 => 4.9222, std.dev.: 0.0137)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.20% (1.3059 => 1.3346, std.dev.: 0.0096)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.92% (4.0495 => 4.1274, std.dev.: 0.0086)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.62% (11.3998 => 11.5844, std.dev.: 0.0502)
  MultiSource/Applications/JM/lencod/lencod: 1.41% (6.8137 => 6.9098, std.dev.: 0.0289)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -31.61% (0.1335 => 0.0913, std.dev.: 0.0082)
  MultiSource/Benchmarks/NPB-serial/is/is: -27.78% (0.1177 => 0.0850, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -18.67% (1.9909 => 1.6192, std.dev.: 0.0533)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -17.66% (1.8300 => 1.5068, std.dev.: 0.0977)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -8.93% (1.2862 => 1.1713, std.dev.: 0.0246)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.15% (0.1913 => 0.1757, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.28% (1.9411 => 1.8192, std.dev.: 0.0387)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -14.24% (0.4838 => 0.4149, std.dev.: 0.0250)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -7.81% (2.6705 => 2.4619, std.dev.: 0.0436)
  MultiSource/Applications/lua/lua: -3.15% (30.0728 => 29.1248, std.dev.: 0.3567)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.69% (3.7188 => 3.6560, std.dev.: 0.0185)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.30% (5.3965 => 5.3263, std.dev.: 0.0056)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 5.15% (0.1398 => 0.1470, std.dev.: 0.0083)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/build2: 63.49% (0.0367 => 0.0600, std.dev.: 0.0012)
  SingleSource/UnitTests/Vector/simple: 61.44% (0.0236 => 0.0381, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/sumarray: 61.24% (0.0209 => 0.0337, std.dev.: 0.0011)
  SingleSource/UnitTests/2003-04-22-Switch: 59.67% (0.0181 => 0.0289, std.dev.: 0.0032)
  SingleSource/UnitTests/2003-05-07-VarArgs: 59.30% (0.0258 => 0.0411, std.dev.: 0.0010)
  SingleSource/UnitTests/2002-10-12-StructureArgs: 56.91% (0.0181 => 0.0284, std.dev.: 0.0019)
  SingleSource/UnitTests/SignlessTypes/factor: 53.83% (0.0366 => 0.0563, std.dev.: 0.0018)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: 47.19% (0.0231 => 0.0340, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/multiplies: 45.27% (0.0349 => 0.0507, std.dev.: 0.0026)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 41.38% (0.0795 => 0.1124, std.dev.: 0.0041)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 40.32% (0.0253 => 0.0355, std.dev.: 0.0039)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 37.24% (0.1563 => 0.2145, std.dev.: 0.0111)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.83% (2.6076 => 2.8379, std.dev.: 0.0202)
  SingleSource/Benchmarks/Shootout-C++/moments: 8.06% (0.4006 => 0.4329, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.68% (4.1734 => 4.4103, std.dev.: 0.0895)
  MultiSource/Applications/ClamAV/clamscan: 4.62% (17.3229 => 18.1238, std.dev.: 0.1621)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.44% (1.5612 => 1.5993, std.dev.: 0.0105)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary: 19.12% (0.0633 => 0.0754, std.dev.: 0.0031)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.48% (0.9806 => 1.0932, std.dev.: 0.0282)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 8.32% (39.1740 => 42.4341, std.dev.: 0.8900)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.81% (0.8276 => 0.8840, std.dev.: 0.0163)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.94% (32.4581 => 34.3858, std.dev.: 0.3696)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.70% (1.2224 => 1.2921, std.dev.: 0.0244)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.65% (0.2072 => 0.2189, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.98% (40.6198 => 42.6419, std.dev.: 0.7566)
  SingleSource/Benchmarks/Misc/ffbench: 4.83% (1.3696 => 1.4358, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.32% (1.0571 => 1.1028, std.dev.: 0.0051)
  MultiSource/Benchmarks/Bullet/bullet: 4.10% (7.1938 => 7.4889, std.dev.: 0.0141)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.93% (3.9713 => 4.1274, std.dev.: 0.0086)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 3.59% (10.2418 => 10.6091, std.dev.: 0.0646)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.04% (16.4665 => 16.9663, std.dev.: 0.1542)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.00% (1.3084 => 1.3346, std.dev.: 0.0096)
  MultiSource/Applications/spiff/spiff: 1.32% (2.8536 => 2.8913, std.dev.: 0.0081)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 1.29% (88.2998 => 89.4361, std.dev.: 0.1310)
  SingleSource/Benchmarks/Shootout/methcall: 1.21% (8.3425 => 8.4438, std.dev.: 0.0379)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/whetstone: -14.04% (0.1097 => 0.0943, std.dev.: 0.0049)
  MultiSource/Applications/JM/lencod/lencod: -9.57% (18.9387 => 17.1264, std.dev.: 0.5316)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.05% (1.7804 => 1.6192, std.dev.: 0.0533)
  MultiSource/Applications/lemon/lemon: -6.82% (1.3155 => 1.2258, std.dev.: 0.0325)
  MultiSource/Benchmarks/McCat/05-eks/eks: -5.97% (0.5698 => 0.5358, std.dev.: 0.0057)
  MultiSource/Benchmarks/McCat/09-vor/vor: -5.56% (0.3723 => 0.3516, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.55% (0.4554 => 0.4438, std.dev.: 0.0040)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.39% (1.2911 => 0.7309, std.dev.: 0.0028)
  MultiSource/Applications/lemon/lemon: -28.48% (1.3499 => 0.9655, std.dev.: 0.0748)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.47% (4.4050 => 3.2389, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.10% (6.2328 => 5.0425, std.dev.: 0.0240)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.60% (25.3677 => 21.1569, std.dev.: 0.1140)
  SingleSource/Benchmarks/Misc/salsa20: -12.87% (10.3398 => 9.0092, std.dev.: 0.0082)
  MultiSource/Applications/SIBsim4/SIBsim4: -11.24% (3.5327 => 3.1358, std.dev.: 0.1024)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.99% (48.3307 => 44.4702, std.dev.: 0.0765)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.59% (4.5717 => 4.3160, std.dev.: 0.0132)
  MultiSource/Applications/sqlite3/sqlite3: -3.54% (4.6358 => 4.4716, std.dev.: 0.0508)
  SingleSource/Benchmarks/Misc/flops: -3.21% (10.2170 => 9.8892, std.dev.: 0.0475)
  MultiSource/Benchmarks/BitBench/five11/five11: -3.03% (5.7342 => 5.5602, std.dev.: 0.0538)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.67% (1.6679 => 1.6234, std.dev.: 0.0142)
  MultiSource/Applications/JM/lencod/lencod: -1.78% (7.0353 => 6.9098, std.dev.: 0.0289)
  SingleSource/Benchmarks/Shootout/hash: -1.50% (5.3656 => 5.2851, std.dev.: 0.0306)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.01% (0.1441 => 0.1470, std.dev.: 0.0083)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130528/0a0454c3/attachment.html>


More information about the llvm-testresults mailing list