[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Aug 27 20:00:10 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14861?compare_to=14858&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14861, Order: 189429, Start Time: 2013-08-28 01:10:02, End Time: 2013-08-28 03:02:25
      To: 14858, Order: 189408, Start Time: 2013-08-27 22:45:26, End Time: 2013-08-28 00:42:45
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 20 (65 on baseline)
Performance Improvements: 28 (28 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1059 (1014 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-3: 54.29% (0.0326 => 0.0503, std.dev.: 0.0023)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 53.85% (0.0286 => 0.0440, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/flops-7: 51.89% (0.0318 => 0.0483, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/ffbench: 47.72% (0.0832 => 0.1229, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc/dt: 39.19% (0.0393 => 0.0547, std.dev.: 0.0055)
  SingleSource/Benchmarks/Stanford/RealMM: 37.48% (0.0555 => 0.0763, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc/mandel: 32.53% (0.0621 => 0.0823, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.56% (0.3657 => 0.4299, std.dev.: 0.0092)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.92% (6.7150 => 7.4480, std.dev.: 0.1038)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.14% (0.9980 => 1.0992, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.92% (0.4383 => 0.4818, std.dev.: 0.0050)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Bubblesort: 62.99% (0.0354 => 0.0577, std.dev.: 0.0027)
  SingleSource/Benchmarks/Stanford/Perm: 36.92% (0.0325 => 0.0445, std.dev.: 0.0018)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 12.17% (1.0992 => 1.2330, std.dev.: 0.0058)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 7.49% (2.3625 => 2.5394, std.dev.: 0.0340)
  SingleSource/Benchmarks/Misc/ffbench: 6.88% (1.3680 => 1.4621, std.dev.: 0.0177)
  SingleSource/Benchmarks/Misc/mandel: 5.78% (1.0407 => 1.1009, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/pi: 2.54% (2.4686 => 2.5313, std.dev.: 0.0073)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.58% (0.7038 => 0.7149, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/flops-4: 1.09% (1.6528 => 1.6708, std.dev.: 0.0046)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/flops-4: -29.69% (0.0549 => 0.0386, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.95% (0.1378 => 0.1048, std.dev.: 0.0084)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -18.51% (0.4121 => 0.3358, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -15.40% (1.5794 => 1.3361, std.dev.: 0.0849)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -14.96% (1.6829 => 1.4311, std.dev.: 0.0852)
  SingleSource/Benchmarks/CoyoteBench/almabench: -13.51% (0.0970 => 0.0839, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.95% (1.7348 => 1.5101, std.dev.: 0.0801)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -12.52% (0.2012 => 0.1760, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -12.35% (1.6062 => 1.4079, std.dev.: 0.0684)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.13% (2.1921 => 1.9482, std.dev.: 0.0568)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -10.37% (0.1109 => 0.0994, std.dev.: 0.0022)
  MultiSource/Applications/Burg/burg: -10.06% (1.6626 => 1.4953, std.dev.: 0.0449)
  SingleSource/Benchmarks/Shootout-C++/lists1: -9.97% (0.4191 => 0.3773, std.dev.: 0.0063)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.80% (0.4194 => 0.3825, std.dev.: 0.0106)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -8.75% (0.1394 => 0.1272, std.dev.: 0.0038)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -8.10% (52.1548 => 47.9306, std.dev.: 1.3384)
  SingleSource/Benchmarks/Shootout-C++/wc: -5.29% (0.2797 => 0.2649, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.42% (1.5010 => 1.4346, std.dev.: 0.0191)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.95% (0.7218 => 0.7005, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.68% (1.5400 => 1.4988, std.dev.: 0.0101)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.62% (1.2386 => 1.2185, std.dev.: 0.0019)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -23.78% (0.0719 => 0.0548, std.dev.: 0.0049)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -11.87% (0.1676 => 0.1477, std.dev.: 0.0070)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.52% (1.5270 => 1.4580, std.dev.: 0.0177)
  SingleSource/Benchmarks/Shootout-C++/hash: -3.76% (0.8362 => 0.8048, std.dev.: 0.0119)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -2.91% (5.1115 => 4.9629, std.dev.: 0.0495)
  SingleSource/Benchmarks/Shootout/lists: -1.52% (7.2492 => 7.1388, std.dev.: 0.0408)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.52% (3.2422 => 3.1930, std.dev.: 0.0110)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.80% (0.1341 => 0.1290, std.dev.: 0.0335)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-04-20-LoopBug2: 147.22% (0.0072 => 0.0178, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/mandel: 68.65% (0.0488 => 0.0823, std.dev.: 0.0054)
  SingleSource/Benchmarks/Stanford/RealMM: 60.63% (0.0475 => 0.0763, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc/flops-3: 58.68% (0.0317 => 0.0503, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/flops-7: 53.82% (0.0314 => 0.0483, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/ffbench: 52.29% (0.0807 => 0.1229, std.dev.: 0.0043)
  SingleSource/Benchmarks/McGill/exptree: 52.02% (0.0992 => 0.1508, std.dev.: 0.0169)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 45.70% (0.0302 => 0.0440, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/dt: 41.71% (0.0386 => 0.0547, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/mandel-2: 38.67% (0.0331 => 0.0459, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.68% (0.3592 => 0.4299, std.dev.: 0.0092)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 14.62% (6.4979 => 7.4480, std.dev.: 0.1038)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 12.88% (0.0784 => 0.0885, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.61% (0.9761 => 1.0992, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.81% (0.4309 => 0.4818, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/hash: 10.81% (0.4534 => 0.5024, std.dev.: 0.0068)
  SingleSource/Benchmarks/Shootout-C++/lists1: 9.65% (0.3441 => 0.3773, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout-C++/wc: 7.77% (0.2458 => 0.2649, std.dev.: 0.0051)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.55% (1.1882 => 1.2185, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 77.99% (3.7285 => 6.6364, std.dev.: 0.0136)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 70.94% (2.9033 => 4.9629, std.dev.: 0.0495)
  SingleSource/Benchmarks/Stanford/Bubblesort: 51.84% (0.0380 => 0.0577, std.dev.: 0.0027)
  MultiSource/Benchmarks/FreeBench/neural/neural: 31.82% (0.3171 => 0.4180, std.dev.: 0.0226)
  SingleSource/Benchmarks/Shootout/hash: 30.32% (4.1846 => 5.4534, std.dev.: 0.2504)
  SingleSource/Benchmarks/Shootout-C++/hash: 27.85% (0.6295 => 0.8048, std.dev.: 0.0119)
  SingleSource/Benchmarks/Misc/pi: 27.62% (1.9835 => 2.5313, std.dev.: 0.0073)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 27.02% (2.9428 => 3.7380, std.dev.: 0.2891)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 24.89% (0.0458 => 0.0572, std.dev.: 0.0000)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.84% (9.6817 => 11.6993, std.dev.: 0.0622)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.65% (3.0680 => 3.5788, std.dev.: 0.1320)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 13.69% (4.6576 => 5.2951, std.dev.: 0.0305)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 12.46% (1.0964 => 1.2330, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.71% (4.9231 => 5.4994, std.dev.: 0.0283)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.29% (7.0762 => 7.8748, std.dev.: 0.2314)
  SingleSource/Benchmarks/Shootout/ary3: 10.82% (5.8158 => 6.4451, std.dev.: 0.0599)
  SingleSource/Benchmarks/Linpack/linpack-pc: 9.05% (48.3256 => 52.6993, std.dev.: 0.0596)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.37% (1.2557 => 1.3608, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.36% (2.9467 => 3.1930, std.dev.: 0.0110)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.12% (14.9584 => 16.1731, std.dev.: 0.4045)
  SingleSource/Benchmarks/Misc/ffbench: 6.89% (1.3679 => 1.4621, std.dev.: 0.0177)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 6.28% (2.3894 => 2.5394, std.dev.: 0.0340)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6220, std.dev.: 0.0798)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.92% (3.3384 => 3.5362, std.dev.: 0.0687)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.66% (3.3464 => 3.5357, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.60% (3.4085 => 3.5994, std.dev.: 0.0640)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.51% (3.7593 => 3.9666, std.dev.: 0.0159)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.44% (4.9040 => 5.1707, std.dev.: 0.0593)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.27% (5.5008 => 5.7908, std.dev.: 0.0349)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.87% (2.3304 => 2.4438, std.dev.: 0.0203)
  SingleSource/Benchmarks/Shootout-C++/hash2: 4.68% (3.3877 => 3.5463, std.dev.: 0.0192)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.65% (6.1245 => 6.4091, std.dev.: 0.0269)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3657, std.dev.: 0.0149)
  SingleSource/Benchmarks/Misc/whetstone: 4.18% (3.4559 => 3.6004, std.dev.: 0.0183)
  SingleSource/Benchmarks/McGill/queens: 4.09% (1.6536 => 1.7212, std.dev.: 0.0150)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.42% (25.0200 => 25.8758, std.dev.: 0.0393)
  SingleSource/Benchmarks/Misc/flops-4: 3.37% (1.6164 => 1.6708, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.05% (4.8739 => 5.0224, std.dev.: 0.0466)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.99% (1.3104 => 1.3496, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.43% (4.4624 => 4.5708, std.dev.: 0.0254)
  SingleSource/Benchmarks/Shootout-C++/sieve: 2.41% (3.4566 => 3.5399, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.13% (12.8625 => 13.1362, std.dev.: 0.0796)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.98% (1.5957 => 1.6273, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc/dt: 1.08% (0.9776 => 0.9882, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/flops: 1.03% (9.7664 => 9.8668, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.02% (11.5371 => 11.6547, std.dev.: 0.0183)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/hexxagon/hexxagon: -14.93% (1.3285 => 1.1301, std.dev.: 0.0731)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.58% (0.7091 => 0.6199, std.dev.: 0.0273)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.18% (0.1870 => 0.1661, std.dev.: 0.0059)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.79% (0.3073 => 0.2803, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -8.13% (0.3655 => 0.3358, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.02% (1.4947 => 1.4346, std.dev.: 0.0191)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.52% (5.2851 => 5.1521, std.dev.: 0.0345)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.40% (1.5357 => 1.4988, std.dev.: 0.0101)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.35% (2.1022 => 1.4222, std.dev.: 0.0202)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -29.90% (0.0816 => 0.0572, std.dev.: 0.0004)
  MultiSource/Applications/viterbi/viterbi: -27.03% (3.4923 => 2.5485, std.dev.: 0.0086)
  SingleSource/Benchmarks/Misc/perlin: -21.00% (4.5989 => 3.6331, std.dev.: 0.1061)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -15.71% (5.3098 => 4.4758, std.dev.: 0.0851)
  SingleSource/Benchmarks/Shootout-C++/matrix: -11.29% (2.8867 => 2.5608, std.dev.: 0.0046)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.32% (0.5173 => 0.4691, std.dev.: 0.0019)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -8.69% (2.6992 => 2.4646, std.dev.: 0.0701)
  SingleSource/Benchmarks/Misc/mandel: -8.23% (1.1996 => 1.1009, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/fp-convert: -6.28% (8.0730 => 7.5658, std.dev.: 0.0459)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.30% (3.8119 => 3.6478, std.dev.: 0.0095)
  SingleSource/Benchmarks/Misc/fbench: -4.18% (4.9602 => 4.7527, std.dev.: 0.0091)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.09% (1.1024 => 1.0573, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.15% (5.0417 => 4.8828, std.dev.: 0.0301)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9619, std.dev.: 0.0189)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.80% (0.7355 => 0.7149, std.dev.: 0.0022)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.62% (21.6864 => 21.1193, std.dev.: 0.2177)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.24% (47.2250 => 46.1680, std.dev.: 0.1494)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.04% (8.6172 => 8.4412, std.dev.: 0.0454)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.89% (34.8438 => 34.1842, std.dev.: 0.0919)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.39% (0.1378 => 0.1290, std.dev.: 0.0335)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130827/1e70837e/attachment.html>


More information about the llvm-testresults mailing list