[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Aug 15 18:51:03 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14457?compare_to=14454&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14457, Order: 188508, Start Time: 2013-08-15 23:55:01, End Time: 2013-08-16 01:53:05
      To: 14454, Order: 188488, Start Time: 2013-08-15 21:32:50, End Time: 2013-08-15 23:27:34
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 26 (57 on baseline)
Performance Improvements: 3 (20 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1078 (1030 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 63.25% (0.0634 => 0.1035, std.dev.: 0.0059)
  MultiSource/Benchmarks/McCat/15-trie/trie: 62.44% (0.0647 => 0.1051, std.dev.: 0.0041)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 59.02% (0.0388 => 0.0617, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/whetstone: 54.58% (0.1026 => 0.1586, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc/flops-7: 54.04% (0.0322 => 0.0496, std.dev.: 0.0044)
  MultiSource/Benchmarks/Olden/em3d/em3d: 50.07% (0.2159 => 0.3240, std.dev.: 0.0161)
  MultiSource/Benchmarks/McCat/09-vor/vor: 36.14% (0.3647 => 0.4965, std.dev.: 0.0183)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 29.43% (0.0350 => 0.0453, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.23% (4.8886 => 5.9263, std.dev.: 0.2265)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 13.83% (0.4043 => 0.4602, std.dev.: 0.0148)
  MultiSource/Applications/hbd/hbd: 12.52% (1.9918 => 2.2412, std.dev.: 0.0253)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/JM/ldecod/ldecod: 38.84% (0.0654 => 0.0908, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 35.51% (5.0822 => 6.8869, std.dev.: 0.1574)
  SingleSource/Benchmarks/Shootout-C++/strcat: 26.38% (0.0872 => 0.1102, std.dev.: 0.0044)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 20.83% (0.0504 => 0.0609, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.76% (4.1329 => 4.8255, std.dev.: 0.0972)
  MultiSource/Benchmarks/nbench/nbench: 12.95% (19.4671 => 21.9877, std.dev.: 0.6042)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 9.95% (9.6887 => 10.6524, std.dev.: 0.2937)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.54% (15.6843 => 16.7099, std.dev.: 0.2721)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 6.07% (0.2191 => 0.2324, std.dev.: 0.0037)
  MultiSource/Benchmarks/Olden/bh/bh: 5.65% (2.4353 => 2.5728, std.dev.: 0.0462)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.69% (6.2705 => 6.5019, std.dev.: 0.0194)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.04% (5.2143 => 5.3729, std.dev.: 0.0208)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.91% (2.5091 => 2.5570, std.dev.: 0.0176)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.59% (3.5166 => 3.5726, std.dev.: 0.0137)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.42% (1.1782 => 1.1949, std.dev.: 0.0029)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.55% (0.6840 => 0.6255, std.dev.: 0.0209)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -8.24% (0.5061 => 0.4644, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.91% (5.1150 => 4.9663, std.dev.: 0.0514)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.72% (0.1340 => 0.1317, std.dev.: 0.0282)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/whetstone: 68.37% (0.0942 => 0.1586, std.dev.: 0.0016)
  MultiSource/Benchmarks/McCat/15-trie/trie: 64.48% (0.0639 => 0.1051, std.dev.: 0.0041)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 63.51% (0.0633 => 0.1035, std.dev.: 0.0059)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 60.68% (0.0384 => 0.0617, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/flops-3: 59.62% (0.0317 => 0.0506, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/flops-7: 57.96% (0.0314 => 0.0496, std.dev.: 0.0044)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 50.00% (0.0302 => 0.0453, std.dev.: 0.0022)
  MultiSource/Benchmarks/Olden/em3d/em3d: 36.88% (0.2367 => 0.3240, std.dev.: 0.0161)
  MultiSource/Benchmarks/McCat/09-vor/vor: 35.29% (0.3670 => 0.4965, std.dev.: 0.0183)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 29.78% (0.3546 => 0.4602, std.dev.: 0.0148)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 24.22% (4.7710 => 5.9263, std.dev.: 0.2265)
  SingleSource/Benchmarks/Shootout-C++/hash2: 21.35% (0.4919 => 0.5969, std.dev.: 0.0357)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.75% (1.9317 => 2.1779, std.dev.: 0.0487)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.11% (1.4732 => 1.6368, std.dev.: 0.0439)
  MultiSource/Applications/hbd/hbd: 10.99% (2.0193 => 2.2412, std.dev.: 0.0253)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.66% (1.3993 => 1.5484, std.dev.: 0.0362)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.90% (1.4037 => 1.5426, std.dev.: 0.0511)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 74.38% (3.7285 => 6.5019, std.dev.: 0.0194)
  SingleSource/Benchmarks/Shootout/ary3: 63.30% (5.8158 => 9.4970, std.dev.: 0.7915)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 51.30% (4.5517 => 6.8869, std.dev.: 0.1574)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.10% (2.8867 => 4.3041, std.dev.: 0.0766)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 46.68% (2.9033 => 4.2586, std.dev.: 0.3417)
  MultiSource/Benchmarks/Olden/mst/mst: 38.19% (0.2134 => 0.2949, std.dev.: 0.0281)
  SingleSource/Benchmarks/Shootout-C++/strcat: 34.06% (0.0822 => 0.1102, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/hash: 28.53% (0.6295 => 0.8091, std.dev.: 0.0264)
  SingleSource/Benchmarks/Shootout/hash: 26.60% (4.1846 => 5.2978, std.dev.: 0.1568)
  SingleSource/Benchmarks/Misc/pi: 26.52% (1.9835 => 2.5096, std.dev.: 0.0132)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.50% (1.5030 => 1.8863, std.dev.: 0.0372)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 19.65% (0.0509 => 0.0609, std.dev.: 0.0024)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 16.60% (9.1355 => 10.6524, std.dev.: 0.2937)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.71% (14.9584 => 16.7099, std.dev.: 0.2721)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.08% (7.0762 => 7.8600, std.dev.: 0.0903)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.77% (5.4910 => 5.9727, std.dev.: 0.0354)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.05% (48.3256 => 52.2146, std.dev.: 0.1738)
  SingleSource/Benchmarks/Shootout-C++/ary3: 6.97% (2.0229 => 2.1638, std.dev.: 0.0542)
  SingleSource/Benchmarks/Misc/ffbench: 6.85% (1.3679 => 1.4616, std.dev.: 0.0227)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.82% (3.4085 => 3.6409, std.dev.: 0.0576)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.45% (5.5008 => 5.8557, std.dev.: 0.0621)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 5.62% (2.3894 => 2.5237, std.dev.: 0.0434)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.37% (5.1471 => 5.4233, std.dev.: 0.0353)
  MultiSource/Applications/siod/siod: 5.21% (3.3761 => 3.5520, std.dev.: 0.0532)
  SingleSource/Benchmarks/Shootout-C++/hash2: 4.71% (3.3877 => 3.5472, std.dev.: 0.0380)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.41% (3.3384 => 3.4856, std.dev.: 0.0234)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.38% (4.3151 => 4.5041, std.dev.: 0.0634)
  SingleSource/Benchmarks/Misc/whetstone: 4.35% (3.4559 => 3.6063, std.dev.: 0.0135)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.09% (6.1245 => 6.3752, std.dev.: 0.0797)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 3.99% (0.2679 => 0.2786, std.dev.: 0.0021)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.64% (25.0200 => 25.9301, std.dev.: 0.2065)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.42% (1.3104 => 1.3552, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout-C++/sieve: 3.36% (3.4566 => 3.5726, std.dev.: 0.0137)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.12% (4.8739 => 5.0258, std.dev.: 0.0394)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 2.85% (1.1618 => 1.1949, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.52% (12.8625 => 13.1865, std.dev.: 0.0520)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.47% (1.5957 => 1.6351, std.dev.: 0.0125)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.95% (2.5081 => 2.5570, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.50% (9.7023 => 9.8481, std.dev.: 0.0307)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.19% (5.3098 => 5.3729, std.dev.: 0.0208)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.79% (0.7091 => 0.6255, std.dev.: 0.0209)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.34% (2.1022 => 1.4434, std.dev.: 0.0052)
  MultiSource/Applications/viterbi/viterbi: -26.91% (3.4923 => 2.5524, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.48% (6.9552 => 5.2523, std.dev.: 0.0243)
  SingleSource/Benchmarks/Misc/perlin: -21.01% (4.5989 => 3.6325, std.dev.: 0.0679)
  SingleSource/Benchmarks/Misc/mandel: -13.05% (1.1996 => 1.0430, std.dev.: 0.0492)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.88% (6.2627 => 5.5185, std.dev.: 0.1980)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.45% (0.5173 => 0.4684, std.dev.: 0.0167)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -7.62% (0.2047 => 0.1891, std.dev.: 0.0052)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.16% (47.2250 => 44.3150, std.dev.: 0.4278)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.88% (3.8119 => 3.6258, std.dev.: 0.0638)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.03% (1.1024 => 1.0580, std.dev.: 0.0066)
  SingleSource/Benchmarks/Misc/fbench: -3.83% (4.9602 => 4.7704, std.dev.: 0.0085)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -2.91% (0.4783 => 0.4644, std.dev.: 0.0010)
  SingleSource/Regression/C/uint64_to_float: -2.34% (1.5184 => 1.4828, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.82% (5.2218 => 5.1268, std.dev.: 0.0216)
  SingleSource/Benchmarks/Misc/oourafft: -1.45% (3.7891 => 3.7340, std.dev.: 0.0104)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.33% (1.2012 => 1.1852, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.28% (5.8810 => 5.8058, std.dev.: 0.0267)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.17% (2.1343 => 2.1094, std.dev.: 0.0056)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.43% (0.1378 => 0.1317, std.dev.: 0.0282)

Report Time: 0.69s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130815/a75499ac/attachment.html>


More information about the llvm-testresults mailing list