[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Aug 13 19:53:03 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14385?compare_to=14381&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14385, Order: 188335, Start Time: 2013-08-14 00:47:06, End Time: 2013-08-14 02:55:01
      To: 14381, Order: 188316, Start Time: 2013-08-13 22:20:49, End Time: 2013-08-14 00:16:54
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 48 (59 on baseline)
Performance Improvements: 6 (12 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1053 (1036 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 69.67% (0.0488 => 0.0828, std.dev.: 0.0108)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 56.79% (0.0780 => 0.1223, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.63% (0.2630 => 0.3909, std.dev.: 0.0287)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 47.29% (0.0258 => 0.0380, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout-C++/lists: 46.88% (0.2903 => 0.4264, std.dev.: 0.0471)
  SingleSource/Benchmarks/Shootout/methcall: 45.55% (0.0382 => 0.0556, std.dev.: 0.0065)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 43.32% (0.9963 => 1.4279, std.dev.: 0.0518)
  SingleSource/Benchmarks/Shootout-C++/moments: 43.27% (0.4190 => 0.6003, std.dev.: 0.0172)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 43.04% (0.0632 => 0.0904, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 42.06% (1.3347 => 1.8961, std.dev.: 0.0168)
  SingleSource/Benchmarks/Misc-C++/bigfib: 41.28% (0.7287 => 1.0295, std.dev.: 0.0381)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 40.63% (0.8039 => 1.1305, std.dev.: 0.0379)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 39.33% (0.0356 => 0.0496, std.dev.: 0.0023)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 37.31% (1.2242 => 1.6809, std.dev.: 0.0575)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.80% (0.0519 => 0.0710, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 36.40% (0.2390 => 0.3260, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 35.61% (0.2578 => 0.3496, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/fibo: 34.30% (0.2114 => 0.2839, std.dev.: 0.0233)
  SingleSource/Regression/C/bigstack: 34.04% (0.0661 => 0.0886, std.dev.: 0.0034)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 31.59% (0.1168 => 0.1537, std.dev.: 0.0106)
  SingleSource/Benchmarks/Shootout/lists: 30.48% (0.0817 => 0.1066, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/ary3: 30.47% (0.2931 => 0.3824, std.dev.: 0.0231)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.88% (1.4180 => 1.6999, std.dev.: 0.1063)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 92.86% (5.1419 => 9.9169, std.dev.: 0.4351)
  SingleSource/Benchmarks/Shootout/heapsort: 61.22% (3.6643 => 5.9075, std.dev.: 0.1119)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 52.31% (1.0841 => 1.6512, std.dev.: 0.0586)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 50.03% (4.0749 => 6.1134, std.dev.: 0.0759)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 22.40% (2.4149 => 2.9559, std.dev.: 0.0459)
  SingleSource/Benchmarks/Shootout-C++/ary3: 17.89% (2.0397 => 2.4047, std.dev.: 0.0313)
  SingleSource/Benchmarks/Shootout-C++/moments: 17.03% (0.1016 => 0.1189, std.dev.: 0.0052)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.67% (0.0972 => 0.1134, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.01% (2.7441 => 2.9364, std.dev.: 0.0616)
  SingleSource/Benchmarks/Misc/flops-7: 6.99% (1.7976 => 1.9232, std.dev.: 0.0176)
  SingleSource/Benchmarks/Shootout-C++/fibo: 6.45% (4.5599 => 4.8542, std.dev.: 0.0240)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.30% (0.7050 => 0.7494, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.03% (3.6083 => 3.8260, std.dev.: 0.0768)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 4.39% (5.8237 => 6.0795, std.dev.: 0.0820)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.36% (5.9558 => 6.1561, std.dev.: 0.0675)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.72% (6.2465 => 6.4161, std.dev.: 0.0648)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.59% (3.0900 => 3.1701, std.dev.: 0.0150)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.47% (1.7632 => 1.8067, std.dev.: 0.0134)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.40% (11.3735 => 11.6470, std.dev.: 0.0405)
  SingleSource/Benchmarks/Shootout/lists: 2.31% (7.1569 => 7.3222, std.dev.: 0.0476)
  SingleSource/Benchmarks/Shootout/methcall: 2.18% (8.3582 => 8.5403, std.dev.: 0.0367)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.73% (1.4285 => 1.4532, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/matrix: 1.50% (4.2808 => 4.3451, std.dev.: 0.0214)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.08% (25.8437 => 26.1233, std.dev.: 0.0989)
  SingleSource/Benchmarks/Misc/fbench: 1.01% (4.7434 => 4.7914, std.dev.: 0.0044)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -22.30% (0.3242 => 0.2519, std.dev.: 0.0009)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.50% (1.7093 => 1.5127, std.dev.: 0.0416)
  MultiSource/Applications/lemon/lemon: -7.02% (1.3354 => 1.2416, std.dev.: 0.0351)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -6.14% (0.2021 => 0.1897, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.73% (5.6365 => 5.4827, std.dev.: 0.0471)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.36% (4.4880 => 4.4270, std.dev.: 0.0224)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -15.91% (0.1559 => 0.1311, std.dev.: 0.0190)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-04-20-LoopBug2: 143.06% (0.0072 => 0.0175, std.dev.: 0.0034)
  SingleSource/Regression/C/bigstack: 90.13% (0.0466 => 0.0886, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout/heapsort: 79.22% (0.0462 => 0.0828, std.dev.: 0.0108)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 55.99% (0.0784 => 0.1223, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout/methcall: 53.59% (0.0362 => 0.0556, std.dev.: 0.0065)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.83% (0.2609 => 0.3909, std.dev.: 0.0287)
  SingleSource/Benchmarks/Shootout-C++/lists: 49.25% (0.2857 => 0.4264, std.dev.: 0.0471)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 46.29% (0.9761 => 1.4279, std.dev.: 0.0518)
  SingleSource/Benchmarks/Shootout-C++/moments: 45.53% (0.4125 => 0.6003, std.dev.: 0.0172)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 42.81% (0.0633 => 0.0904, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc-C++/bigfib: 41.34% (0.7284 => 1.0295, std.dev.: 0.0381)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 39.77% (0.8088 => 1.1305, std.dev.: 0.0379)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.92% (1.3649 => 1.8961, std.dev.: 0.0168)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 38.35% (0.2527 => 0.3496, std.dev.: 0.0050)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 36.26% (0.0364 => 0.0496, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 35.89% (0.2399 => 0.3260, std.dev.: 0.0033)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 35.50% (0.0524 => 0.0710, std.dev.: 0.0053)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 34.99% (0.0966 => 0.1304, std.dev.: 0.0055)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 33.54% (0.1151 => 0.1537, std.dev.: 0.0106)
  SingleSource/Benchmarks/Shootout-C++/fibo: 32.66% (0.2140 => 0.2839, std.dev.: 0.0233)
  SingleSource/Benchmarks/Shootout/lists: 31.77% (0.0809 => 0.1066, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/ary3: 31.68% (0.2904 => 0.3824, std.dev.: 0.0231)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 29.38% (0.2311 => 0.2990, std.dev.: 0.0258)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 28.54% (10.3031 => 13.2431, std.dev.: 0.8577)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.71% (15.5498 => 18.4591, std.dev.: 0.3329)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 10.38% (1.5228 => 1.6809, std.dev.: 0.0575)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 117.87% (4.5517 => 9.9169, std.dev.: 0.4351)
  SingleSource/Benchmarks/Shootout/heapsort: 102.85% (2.9123 => 5.9075, std.dev.: 0.1119)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 72.08% (3.7285 => 6.4161, std.dev.: 0.0648)
  SingleSource/Benchmarks/Shootout/ary3: 62.72% (5.8158 => 9.4636, std.dev.: 0.9629)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 52.92% (3.9978 => 6.1134, std.dev.: 0.0759)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 50.60% (1.0964 => 1.6512, std.dev.: 0.0586)
  SingleSource/Benchmarks/Shootout-C++/matrix: 50.52% (2.8867 => 4.3451, std.dev.: 0.0214)
  MultiSource/Benchmarks/FreeBench/neural/neural: 38.88% (0.3171 => 0.4404, std.dev.: 0.0340)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.77% (1.5030 => 1.9054, std.dev.: 0.0280)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 23.71% (2.3894 => 2.9559, std.dev.: 0.0459)
  SingleSource/Benchmarks/Misc/pi: 21.80% (1.9835 => 2.4160, std.dev.: 0.0581)
  SingleSource/Benchmarks/Shootout-C++/ary3: 18.87% (2.0229 => 2.4047, std.dev.: 0.0313)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.88% (0.0962 => 0.1134, std.dev.: 0.0017)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.05% (0.1678 => 0.1897, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 12.25% (3.4085 => 3.8260, std.dev.: 0.0768)
  SingleSource/Benchmarks/Misc/flops-7: 10.98% (1.7330 => 1.9232, std.dev.: 0.0176)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.88% (7.0762 => 7.8462, std.dev.: 0.0933)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.67% (5.4910 => 5.9673, std.dev.: 0.1413)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.67% (1.2557 => 1.3646, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.34% (3.2027 => 3.4698, std.dev.: 0.0246)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.89% (5.3042 => 5.7226, std.dev.: 0.0663)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.56% (5.5008 => 5.9164, std.dev.: 0.1160)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.50% (48.3256 => 51.9477, std.dev.: 0.5947)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.98% (6.1245 => 6.4905, std.dev.: 0.0728)
  SingleSource/Benchmarks/Misc/whetstone: 4.42% (3.4559 => 3.6087, std.dev.: 0.0120)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 4.41% (25.0200 => 26.1233, std.dev.: 0.0989)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.41% (4.3151 => 4.5053, std.dev.: 0.0450)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 4.12% (5.8390 => 6.0795, std.dev.: 0.0820)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.33% (3.0680 => 3.1701, std.dev.: 0.0150)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 2.13% (1.4398 => 1.4705, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.61% (4.9040 => 4.9828, std.dev.: 0.0185)
  SingleSource/Benchmarks/Shootout/fib2: 1.11% (4.9231 => 4.9776, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.08% (9.6817 => 9.7866, std.dev.: 0.0029)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -35.45% (1.4194 => 0.9162, std.dev.: 0.0800)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -30.87% (2.1022 => 1.4532, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -28.19% (0.0816 => 0.0586, std.dev.: 0.0036)
  MultiSource/Applications/viterbi/viterbi: -27.38% (3.4923 => 2.5361, std.dev.: 0.0302)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.56% (6.9552 => 5.2468, std.dev.: 0.3250)
  SingleSource/Benchmarks/Misc/perlin: -20.79% (4.5989 => 3.6428, std.dev.: 0.0433)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.45% (6.2627 => 5.4827, std.dev.: 0.0471)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -7.33% (0.2047 => 0.1897, std.dev.: 0.0037)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.30% (47.2250 => 44.2515, std.dev.: 0.8105)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -5.00% (1.1024 => 1.0473, std.dev.: 0.0213)
  SingleSource/Benchmarks/Misc/fbench: -3.40% (4.9602 => 4.7914, std.dev.: 0.0044)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.27% (2.1343 => 2.1073, std.dev.: 0.0074)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.86% (0.1378 => 0.1311, std.dev.: 0.0190)

Report Time: 1.22s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130813/6a079752/attachment.html>


More information about the llvm-testresults mailing list