[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Fri Aug 9 11:25:59 PDT 2013

http://llvm.org/perf/db_default/v4/nts/14259?compare_to=14255&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14259, Order: 188074, Start Time: 2013-08-09 16:32:32, End Time: 2013-08-09 18:27:52
      To: 14255, Order: 188071, Start Time: 2013-08-09 14:24:58, End Time: 2013-08-09 16:10:36
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 49 (57 on baseline)
Performance Improvements: 2 (22 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1054 (1026 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl: 61.99% (0.0221 => 0.0358, std.dev.: 0.0017)
  SingleSource/UnitTests/Vector/build2: 54.03% (0.0372 => 0.0573, std.dev.: 0.0027)
  MultiSource/Applications/obsequi/Obsequi: 42.11% (1.1927 => 1.6949, std.dev.: 0.1628)
  MultiSource/Applications/Burg/burg: 24.97% (1.4817 => 1.8517, std.dev.: 0.0727)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 17.98% (1.6704 => 1.9707, std.dev.: 0.1059)
  MultiSource/Benchmarks/Bullet/bullet: 17.54% (36.2267 => 42.5797, std.dev.: 0.5436)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 15.07% (1.5954 => 1.8359, std.dev.: 0.0323)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.64% (1.3517 => 1.5496, std.dev.: 0.0241)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.11% (26.3061 => 29.7551, std.dev.: 0.3960)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.06% (1.3486 => 1.5247, std.dev.: 0.0401)
  MultiSource/Benchmarks/PAQ8p/paq8p: 12.17% (2.5226 => 2.8295, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 12.02% (1.4345 => 1.6069, std.dev.: 0.0460)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 11.78% (6.5477 => 7.3193, std.dev.: 0.0947)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.28% (0.9917 => 1.1036, std.dev.: 0.0285)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.26% (1.3788 => 1.5341, std.dev.: 0.0453)
  SingleSource/Benchmarks/Misc-C++/bigfib: 10.87% (0.7307 => 0.8101, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.98% (1.4092 => 1.5498, std.dev.: 0.0248)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.95% (0.3147 => 0.3460, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.55% (1.4606 => 1.6001, std.dev.: 0.0534)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.03% (2.6699 => 2.9111, std.dev.: 0.0869)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.77% (0.2565 => 0.2790, std.dev.: 0.0081)
  MultiSource/Applications/siod/siod: 8.61% (2.5472 => 2.7666, std.dev.: 0.0728)
  MultiSource/Applications/oggenc/oggenc: 7.94% (5.8444 => 6.3087, std.dev.: 0.1427)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 69.91% (2.9193 => 4.9601, std.dev.: 0.4748)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 54.61% (0.0965 => 0.1492, std.dev.: 0.0098)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 47.50% (4.5869 => 6.7659, std.dev.: 0.2459)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.03% (1.4779 => 1.8922, std.dev.: 0.0076)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 25.02% (4.0382 => 5.0484, std.dev.: 0.3344)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.56% (40.5688 => 48.9108, std.dev.: 0.5572)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.10% (36.6964 => 43.3372, std.dev.: 1.7502)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.67% (4.1098 => 4.8361, std.dev.: 0.0090)
  SingleSource/Benchmarks/Misc/fp-convert: 16.95% (6.9077 => 8.0784, std.dev.: 0.0086)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 14.64% (0.8314 => 0.9531, std.dev.: 0.0240)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.29% (2.3378 => 2.6017, std.dev.: 0.0268)
  MultiSource/Benchmarks/Bullet/bullet: 9.90% (7.0648 => 7.7639, std.dev.: 0.0633)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.79% (90.6733 => 98.6392, std.dev.: 0.8966)
  MultiSource/Applications/sqlite3/sqlite3: 6.79% (4.2615 => 4.5510, std.dev.: 0.0552)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.11% (1.2910 => 1.3440, std.dev.: 0.0119)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.83% (3.9942 => 4.1471, std.dev.: 0.0364)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.65% (1.2655 => 1.3117, std.dev.: 0.0056)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.05% (39.9647 => 41.1826, std.dev.: 0.3182)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.02% (15.6525 => 16.1253, std.dev.: 0.1578)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.51% (5.8367 => 5.9830, std.dev.: 0.0140)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.20% (4.0871 => 4.1769, std.dev.: 0.0314)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.99% (1.1730 => 1.1964, std.dev.: 0.0049)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.80% (3.4676 => 3.5299, std.dev.: 0.0151)
  SingleSource/Benchmarks/Shootout/fib2: 1.17% (4.9120 => 4.9697, std.dev.: 0.0146)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (5.5737 => 5.6372, std.dev.: 0.0205)
  MultiSource/Applications/viterbi/viterbi: 1.10% (2.5362 => 2.5642, std.dev.: 0.0067)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.93% (0.6675 => 0.6546, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.58% (6.5942 => 6.4900, std.dev.: 0.0335)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: -0.75% (0.1337 => 0.1327, std.dev.: 0.0178)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.26% (0.2734 => 0.2727, std.dev.: 0.0256)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.84% (0.0254 => 0.0279, std.dev.: 0.0064)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.06% (0.2813 => 0.2727, std.dev.: 0.0256)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.13% (0.0345 => 0.0279, std.dev.: 0.0064)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl: 69.67% (0.0211 => 0.0358, std.dev.: 0.0017)
  SingleSource/UnitTests/Vector/build2: 50.79% (0.0380 => 0.0573, std.dev.: 0.0027)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 18.41% (1.6643 => 1.9707, std.dev.: 0.1059)
  MultiSource/Applications/Burg/burg: 17.70% (1.5733 => 1.8517, std.dev.: 0.0727)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 13.69% (1.3630 => 1.5496, std.dev.: 0.0241)
  MultiSource/Benchmarks/Bullet/bullet: 13.59% (37.4863 => 42.5797, std.dev.: 0.5436)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.06% (0.9761 => 1.1036, std.dev.: 0.0285)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 12.64% (6.4979 => 7.3193, std.dev.: 0.0947)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 12.01% (0.3089 => 0.3460, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc-C++/bigfib: 11.22% (0.7284 => 0.8101, std.dev.: 0.0066)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.41% (0.2527 => 0.2790, std.dev.: 0.0081)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.31% (2.6390 => 2.9111, std.dev.: 0.0869)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.29% (1.4037 => 1.5341, std.dev.: 0.0453)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.65% (27.6418 => 29.7551, std.dev.: 0.3960)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.37% (2.6853 => 2.8295, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.34% (1.4853 => 1.5498, std.dev.: 0.0248)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 74.06% (3.7285 => 6.4900, std.dev.: 0.0335)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 70.84% (2.9033 => 4.9601, std.dev.: 0.4748)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 55.09% (0.0962 => 0.1492, std.dev.: 0.0098)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.66% (2.8867 => 4.2915, std.dev.: 0.0278)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 48.65% (4.5517 => 6.7659, std.dev.: 0.2459)
  MultiSource/Benchmarks/FreeBench/neural/neural: 41.12% (0.3171 => 0.4475, std.dev.: 0.0108)
  SingleSource/Benchmarks/Shootout/hash: 30.49% (4.1846 => 5.4605, std.dev.: 0.1977)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 26.28% (3.9978 => 5.0484, std.dev.: 0.3344)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.89% (1.5030 => 1.8922, std.dev.: 0.0076)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.76% (40.5028 => 48.9108, std.dev.: 0.5572)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.48% (36.8900 => 43.3372, std.dev.: 1.7502)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 15.82% (60.3477 => 69.8925, std.dev.: 3.6159)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.98% (7.0762 => 7.8530, std.dev.: 0.0852)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.62% (3.2027 => 3.5108, std.dev.: 0.0842)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.83% (1.2557 => 1.3666, std.dev.: 0.0190)
  MultiSource/Applications/JM/lencod/lencod: 8.67% (7.1799 => 7.8025, std.dev.: 0.1954)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.40% (5.4910 => 5.9522, std.dev.: 0.0439)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.80% (14.9584 => 16.1253, std.dev.: 0.1578)
  MultiSource/Applications/siod/siod: 7.21% (3.3761 => 3.6195, std.dev.: 0.0414)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.74% (48.3256 => 51.5835, std.dev.: 0.5885)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.69% (5.3042 => 5.6589, std.dev.: 0.0218)
  MultiSource/Benchmarks/Bullet/bullet: 6.36% (7.2995 => 7.7639, std.dev.: 0.0633)
  SingleSource/Benchmarks/Misc/flops-7: 5.62% (1.7330 => 1.8304, std.dev.: 0.0375)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.30% (93.6732 => 98.6392, std.dev.: 0.8966)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.97% (5.1471 => 5.4027, std.dev.: 0.0134)
  SingleSource/Benchmarks/Misc/whetstone: 4.68% (3.4559 => 3.6176, std.dev.: 0.0438)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.41% (4.3151 => 4.5056, std.dev.: 0.0016)
  MultiSource/Applications/sqlite3/sqlite3: 3.83% (4.3833 => 4.5510, std.dev.: 0.0552)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.82% (6.1245 => 6.3587, std.dev.: 0.0657)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.78% (1.2639 => 1.3117, std.dev.: 0.0056)
  MultiSource/Applications/spiff/spiff: 3.55% (2.7609 => 2.8589, std.dev.: 0.0093)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.45% (25.0200 => 25.8839, std.dev.: 0.1776)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.36% (4.8739 => 5.0377, std.dev.: 0.0287)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.16% (4.0200 => 4.1471, std.dev.: 0.0364)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 2.98% (1.1618 => 1.1964, std.dev.: 0.0049)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.56% (1.3104 => 1.3440, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.32% (12.8625 => 13.1611, std.dev.: 0.0411)
  SingleSource/Benchmarks/Shootout-C++/sieve: 2.12% (3.4566 => 3.5299, std.dev.: 0.0151)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.63% (1.4398 => 1.4633, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.46% (4.9040 => 4.9756, std.dev.: 0.0267)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.46% (5.8390 => 5.9241, std.dev.: 0.0316)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.96% (0.7091 => 0.6243, std.dev.: 0.0086)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.61% (1.1012 => 1.0064, std.dev.: 0.0110)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.12% (0.2498 => 0.2395, std.dev.: 0.0014)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.36% (2.1022 => 1.4429, std.dev.: 0.0171)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -29.78% (0.0816 => 0.0573, std.dev.: 0.0022)
  MultiSource/Benchmarks/MallocBench/gs/gs: -27.50% (0.1189 => 0.0862, std.dev.: 0.0036)
  MultiSource/Applications/viterbi/viterbi: -26.58% (3.4923 => 2.5642, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.59% (6.9552 => 5.2448, std.dev.: 0.1114)
  SingleSource/Benchmarks/Misc/perlin: -21.43% (4.5989 => 3.6133, std.dev.: 0.1264)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.41% (6.2627 => 5.4230, std.dev.: 0.0457)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.36% (0.5173 => 0.4689, std.dev.: 0.0171)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.74% (3.5791 => 3.3378, std.dev.: 0.0708)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.27% (1.7207 => 1.6301, std.dev.: 0.0136)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.75% (47.2250 => 44.9840, std.dev.: 0.0600)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.51% (1.1024 => 1.0527, std.dev.: 0.0046)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.17% (2.7049 => 2.5922, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.14% (3.8119 => 3.6541, std.dev.: 0.0525)
  SingleSource/Benchmarks/Misc/fbench: -3.74% (4.9602 => 4.7745, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.37% (8.6172 => 8.4133, std.dev.: 0.0226)
  SingleSource/Benchmarks/Misc/oourafft: -2.14% (3.7891 => 3.7080, std.dev.: 0.0087)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.92% (34.8438 => 34.1755, std.dev.: 0.1468)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.02% (6.0444 => 5.9830, std.dev.: 0.0140)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.70% (0.1378 => 0.1327, std.dev.: 0.0178)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130809/80611d99/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results