[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Aug 2 15:30:02 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14043?compare_to=14039&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14043, Order: 187667, Start Time: 2013-08-02 20:39:19, End Time: 2013-08-02 22:31:50
      To: 14039, Order: 187658, Start Time: 2013-08-02 18:18:34, End Time: 2013-08-02 20:16:17
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 22 (51 on baseline)
Performance Improvements: 9 (33 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1074 (1021 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/mandel-2: 58.99% (0.0378 => 0.0601, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 52.48% (0.0423 => 0.0645, std.dev.: 0.0056)
  SingleSource/UnitTests/Vector/constpool: 35.51% (9.5312 => 12.9159, std.dev.: 1.1674)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 10.06% (0.2336 => 0.2571, std.dev.: 0.0065)
  SingleSource/Benchmarks/McGill/chomp: 8.34% (0.1931 => 0.2092, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/moments: 8.26% (0.4296 => 0.4651, std.dev.: 0.0066)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Queens: 54.51% (0.0244 => 0.0377, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 33.04% (3.8618 => 5.1379, std.dev.: 0.0753)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.39% (1.4787 => 1.8837, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout/ary3: 22.25% (9.4146 => 11.5095, std.dev.: 0.1301)
  SingleSource/Benchmarks/Shootout-C++/moments: 15.21% (0.0986 => 0.1136, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/ary3: 11.46% (2.0437 => 2.2779, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.61% (0.3299 => 0.3583, std.dev.: 0.0069)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.71% (0.4276 => 0.4563, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.66% (5.0290 => 5.3135, std.dev.: 0.0245)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.74% (3.2123 => 3.3324, std.dev.: 0.0334)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 3.15% (20.9114 => 21.5703, std.dev.: 0.1571)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.11% (4.9809 => 5.1356, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.29% (6.3839 => 6.5299, std.dev.: 0.0300)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.97% (1.6256 => 1.6577, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.85% (3.5141 => 3.5790, std.dev.: 0.0076)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.44% (2.5720 => 2.6090, std.dev.: 0.0114)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: -32.77% (0.4894 => 0.3290, std.dev.: 0.0291)
  SingleSource/Benchmarks/Misc-C++/bigfib: -24.60% (1.0357 => 0.7809, std.dev.: 0.0515)
  SingleSource/Benchmarks/Shootout-C++/hash: -21.55% (0.6301 => 0.4943, std.dev.: 0.0164)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -12.01% (1.6191 => 1.4246, std.dev.: 0.0354)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -9.46% (1.5395 => 1.3939, std.dev.: 0.0191)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -9.72% (0.2253 => 0.2034, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -8.83% (0.3216 => 0.2932, std.dev.: 0.0083)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.13% (3.2990 => 3.1958, std.dev.: 0.0380)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.61% (5.1034 => 5.0210, std.dev.: 0.0267)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: 1.46% (0.1368 => 0.1388, std.dev.: 0.0131)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.22% (0.2744 => 0.2738, std.dev.: 0.0203)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.72% (0.0279 => 0.0277, std.dev.: 0.0015)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.67% (0.2813 => 0.2738, std.dev.: 0.0203)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.71% (0.0345 => 0.0277, std.dev.: 0.0015)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/mandel-2: 81.57% (0.0331 => 0.0601, std.dev.: 0.0044)
  SingleSource/UnitTests/Vector/constpool: 45.73% (8.8630 => 12.9159, std.dev.: 1.1674)
  SingleSource/Benchmarks/McGill/queens: 44.96% (0.0536 => 0.0777, std.dev.: 0.0090)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 40.52% (0.0459 => 0.0645, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.90% (0.3592 => 0.4271, std.dev.: 0.0140)
  SingleSource/Benchmarks/Shootout-C++/sieve: 17.73% (0.3148 => 0.3706, std.dev.: 0.0207)
  SingleSource/Benchmarks/Shootout-C++/strcat: 17.49% (0.2304 => 0.2707, std.dev.: 0.0113)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.36% (0.4309 => 0.5014, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 15.93% (6.4979 => 7.5332, std.dev.: 0.0794)
  SingleSource/Benchmarks/Shootout-C++/moments: 12.75% (0.4125 => 0.4651, std.dev.: 0.0066)
  SingleSource/Benchmarks/McGill/chomp: 11.87% (0.1870 => 0.2092, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 11.43% (0.2318 => 0.2583, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 11.25% (0.2311 => 0.2571, std.dev.: 0.0065)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.21% (0.2225 => 0.2430, std.dev.: 0.0077)
  SingleSource/Benchmarks/Shootout-C++/lists1: 8.37% (0.3441 => 0.3729, std.dev.: 0.0109)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 97.90% (5.8158 => 11.5095, std.dev.: 0.1301)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 76.97% (2.9033 => 5.1379, std.dev.: 0.0753)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 75.13% (3.7285 => 6.5299, std.dev.: 0.0300)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.28% (2.8867 => 4.3092, std.dev.: 0.0439)
  MultiSource/Benchmarks/FreeBench/neural/neural: 45.35% (0.3171 => 0.4609, std.dev.: 0.0269)
  SingleSource/Benchmarks/Shootout-C++/hash: 29.83% (0.6295 => 0.8173, std.dev.: 0.0144)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.33% (1.5030 => 1.8837, std.dev.: 0.0071)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.46% (29.8131 => 34.1253, std.dev.: 1.2423)
  MultiSource/Applications/JM/lencod/lencod: 14.26% (7.1799 => 8.2041, std.dev.: 0.2217)
  MultiSource/Applications/siod/siod: 13.73% (3.3761 => 3.8398, std.dev.: 0.0355)
  MultiSource/Applications/lambda-0_1_3/lambda: 13.03% (7.0762 => 7.9981, std.dev.: 0.0179)
  SingleSource/Benchmarks/Shootout-C++/ary3: 12.61% (2.0229 => 2.2779, std.dev.: 0.0055)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.38% (1.2557 => 1.3609, std.dev.: 0.0377)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.32% (5.4910 => 5.9480, std.dev.: 0.0549)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.96% (3.4085 => 3.6798, std.dev.: 0.0367)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.89% (48.3256 => 52.1376, std.dev.: 0.4269)
  SingleSource/Benchmarks/Shootout-C++/hash2: 7.87% (3.3877 => 3.6544, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.89% (3.2027 => 3.4235, std.dev.: 0.0321)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.43% (0.2799 => 0.2979, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.01% (5.3042 => 5.6231, std.dev.: 0.0876)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.80% (0.4313 => 0.4563, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.46% (5.5008 => 5.8013, std.dev.: 0.0563)
  SingleSource/Benchmarks/Misc/whetstone: 4.81% (3.4559 => 3.6220, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.39% (4.3151 => 4.5045, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3652, std.dev.: 0.0481)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.71% (3.5351 => 3.6662, std.dev.: 0.0419)
  SingleSource/Benchmarks/Shootout-C++/sieve: 3.54% (3.4566 => 3.5790, std.dev.: 0.0076)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.05% (0.7806 => 0.8044, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.02% (4.8739 => 5.0210, std.dev.: 0.0267)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.83% (16.5294 => 16.9976, std.dev.: 0.1302)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.23% (12.8625 => 13.1498, std.dev.: 0.1032)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.86% (5.0417 => 5.1356, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/flops: 1.81% (9.7664 => 9.9430, std.dev.: 0.0534)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.77% (2.5636 => 2.6090, std.dev.: 0.0114)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.24% (11.5371 => 11.6797, std.dev.: 0.0160)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.11% (4.9040 => 4.9582, std.dev.: 0.0069)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -17.46% (0.1518 => 0.1253, std.dev.: 0.0095)
  MultiSource/Applications/lua/lua: -15.93% (5.3200 => 4.4727, std.dev.: 0.0878)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.32% (0.7091 => 0.6288, std.dev.: 0.0272)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.22% (0.3655 => 0.3318, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.89% (1.4721 => 1.4001, std.dev.: 0.0277)
  MultiSource/Applications/Burg/burg: -4.67% (1.5733 => 1.4998, std.dev.: 0.0176)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.25% (0.7189 => 0.6955, std.dev.: 0.0020)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.18% (2.1022 => 1.4257, std.dev.: 0.0132)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -29.66% (0.0816 => 0.0574, std.dev.: 0.0002)
  MultiSource/Applications/viterbi/viterbi: -27.12% (3.4923 => 2.5453, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.62% (6.9552 => 5.2428, std.dev.: 0.1037)
  SingleSource/Benchmarks/Misc/perlin: -20.89% (4.5989 => 3.6381, std.dev.: 0.0251)
  SingleSource/Benchmarks/Misc/mandel: -13.14% (1.1996 => 1.0420, std.dev.: 0.0156)
  MultiSource/Applications/sgefa/sgefa: -12.91% (1.4030 => 1.2219, std.dev.: 0.0368)
  SingleSource/Benchmarks/Shootout/strcat: -7.91% (0.1593 => 0.1467, std.dev.: 0.0026)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.89% (3.5791 => 3.3324, std.dev.: 0.0334)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -6.68% (0.1542 => 0.1439, std.dev.: 0.0030)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.19% (47.2250 => 44.7739, std.dev.: 0.1595)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.73% (3.8119 => 3.6315, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/fbench: -3.85% (4.9602 => 4.7694, std.dev.: 0.0492)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.66% (1.7207 => 1.6577, std.dev.: 0.0045)
  MultiSource/Benchmarks/Bullet/bullet: -3.38% (7.2995 => 7.0528, std.dev.: 0.0422)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.36% (6.0444 => 5.8411, std.dev.: 0.0509)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.97% (6.1482 => 5.9655, std.dev.: 0.0632)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.91% (1.1024 => 1.0703, std.dev.: 0.0109)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.30% (8.6172 => 8.4190, std.dev.: 0.0213)
  SingleSource/Regression/C/uint64_to_float: -2.04% (1.5184 => 1.4874, std.dev.: 0.0100)
  SingleSource/Benchmarks/Misc/oourafft: -1.99% (3.7891 => 3.7136, std.dev.: 0.0163)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.69% (34.8438 => 34.2532, std.dev.: 0.0914)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.38% (5.8810 => 5.7997, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.36% (4.9231 => 4.8563, std.dev.: 0.0209)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.22% (1.6737 => 1.6533, std.dev.: 0.0052)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.15% (2.1343 => 2.1098, std.dev.: 0.0079)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.73% (0.1378 => 0.1388, std.dev.: 0.0131)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130802/891659de/attachment.html>


More information about the llvm-testresults mailing list