[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Aug 2 13:14:30 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14039?compare_to=14036&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14039, Order: 187658, Start Time: 2013-08-02 18:18:34, End Time: 2013-08-02 20:16:17
      To: 14036, Order: 187654, Start Time: 2013-08-02 16:02:14, End Time: 2013-08-02 17:55:37
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 11 (36 on baseline)
Performance Improvements: 4 (31 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1090 (1038 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: 64.89% (0.2968 => 0.4894, std.dev.: 0.0267)
  SingleSource/Benchmarks/Misc/richards_benchmark: 56.06% (0.0908 => 0.1417, std.dev.: 0.0135)
  SingleSource/Benchmarks/Misc-C++/bigfib: 34.82% (0.7682 => 1.0357, std.dev.: 0.0900)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 14.03% (1.4199 => 1.6191, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.23% (1.3717 => 1.5395, std.dev.: 0.0551)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.33% (1.5130 => 1.6844, std.dev.: 0.0291)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 49.13% (6.3131 => 9.4146, std.dev.: 0.4579)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 20.26% (3.5502 => 4.2693, std.dev.: 0.1885)
  SingleSource/Benchmarks/Shootout-C++/lists: 3.29% (16.3343 => 16.8720, std.dev.: 0.0622)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.75% (12.8341 => 13.1868, std.dev.: 0.0786)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.13% (43.7586 => 44.6924, std.dev.: 0.2002)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -27.02% (0.0729 => 0.0532, std.dev.: 0.0074)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -23.92% (0.1848 => 0.1406, std.dev.: 0.0158)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -13.59% (0.1207 => 0.1043, std.dev.: 0.0025)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.33% (40.8642 => 39.9125, std.dev.: 0.3630)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: -2.15% (0.1398 => 0.1368, std.dev.: 0.0072)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.15% (0.2740 => 0.2744, std.dev.: 0.0033)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.71% (0.0281 => 0.0279, std.dev.: 0.0033)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.45% (0.2813 => 0.2744, std.dev.: 0.0033)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.13% (0.0345 => 0.0279, std.dev.: 0.0033)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-04-20-LoopBug2: 144.44% (0.0072 => 0.0176, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/richards_benchmark: 78.46% (0.0794 => 0.1417, std.dev.: 0.0135)
  SingleSource/Benchmarks/Shootout-C++/ary2: 65.79% (0.2952 => 0.4894, std.dev.: 0.0267)
  SingleSource/Regression/C/bigstack: 44.85% (0.0466 => 0.0675, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc-C++/bigfib: 42.19% (0.7284 => 1.0357, std.dev.: 0.0900)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.39% (1.3946 => 1.5395, std.dev.: 0.0551)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.01% (1.4853 => 1.6191, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.77% (1.5629 => 1.6844, std.dev.: 0.0291)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 71.22% (3.7285 => 6.3839, std.dev.: 0.0865)
  SingleSource/Benchmarks/Shootout/ary3: 61.88% (5.8158 => 9.4146, std.dev.: 0.4579)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.83% (2.8867 => 4.2963, std.dev.: 0.0067)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 45.08% (2.9428 => 4.2693, std.dev.: 0.1885)
  MultiSource/Benchmarks/FreeBench/neural/neural: 40.65% (0.3171 => 0.4460, std.dev.: 0.0310)
  SingleSource/Benchmarks/Shootout/hash: 25.81% (4.1846 => 5.2646, std.dev.: 0.2492)
  MultiSource/Applications/siod/siod: 13.89% (3.3761 => 3.8452, std.dev.: 0.1290)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.66% (7.0762 => 7.9719, std.dev.: 0.0216)
  MultiSource/Applications/JM/lencod/lencod: 8.41% (7.1799 => 7.7839, std.dev.: 0.2061)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.37% (5.4910 => 5.9508, std.dev.: 0.1361)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.05% (48.3256 => 52.2163, std.dev.: 0.3374)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.91% (1.2557 => 1.3550, std.dev.: 0.0234)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.00% (3.2027 => 3.4270, std.dev.: 0.0462)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.03% (5.3042 => 5.6242, std.dev.: 0.0623)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.70% (5.5008 => 5.8144, std.dev.: 0.0819)
  SingleSource/Benchmarks/Misc/whetstone: 4.44% (3.4559 => 3.6095, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.33% (4.3151 => 4.5021, std.dev.: 0.0390)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.30% (3.3464 => 3.4569, std.dev.: 0.0282)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.52% (12.8625 => 13.1868, std.dev.: 0.0786)
  SingleSource/Benchmarks/Shootout/matrix: 2.29% (1.7358 => 1.7755, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.10% (1.5957 => 1.6292, std.dev.: 0.0098)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.07% (16.5294 => 16.8720, std.dev.: 0.0622)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 2.05% (1.1618 => 1.1856, std.dev.: 0.0077)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.9089 => 5.0082, std.dev.: 0.0100)
  SingleSource/Benchmarks/Misc/flops: 1.84% (9.7664 => 9.9463, std.dev.: 0.0099)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.36% (11.5371 => 11.6936, std.dev.: 0.0317)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.26% (4.9040 => 4.9659, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.20% (9.7023 => 9.8186, std.dev.: 0.0357)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/tsp/tsp: -25.80% (0.1818 => 0.1349, std.dev.: 0.0166)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -19.10% (0.1518 => 0.1228, std.dev.: 0.0025)
  MultiSource/Applications/hbd/hbd: -17.54% (2.0193 => 1.6652, std.dev.: 0.0104)
  MultiSource/Applications/hexxagon/hexxagon: -15.63% (1.3285 => 1.1208, std.dev.: 0.0134)
  MultiSource/Applications/lambda-0_1_3/lambda: -11.13% (0.9461 => 0.8408, std.dev.: 0.0138)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.08% (0.3655 => 0.3323, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.80% (0.7189 => 0.6916, std.dev.: 0.0030)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -37.80% (1.4194 => 0.8829, std.dev.: 0.1182)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.90% (2.1022 => 1.4316, std.dev.: 0.1234)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -31.86% (0.0816 => 0.0556, std.dev.: 0.0009)
  MultiSource/Applications/viterbi/viterbi: -27.56% (3.4923 => 2.5297, std.dev.: 0.0194)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.64% (6.9552 => 5.2414, std.dev.: 0.1652)
  SingleSource/Benchmarks/Misc/perlin: -21.20% (4.5989 => 3.6238, std.dev.: 0.0253)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.23% (0.0956 => 0.0820, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc/mandel: -13.97% (1.1996 => 1.0320, std.dev.: 0.0189)
  MultiSource/Applications/sgefa/sgefa: -13.57% (1.4030 => 1.2126, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.52% (6.2627 => 5.4160, std.dev.: 0.2451)
  MultiSource/Applications/SIBsim4/SIBsim4: -10.25% (3.5791 => 3.2123, std.dev.: 0.1373)
  MultiSource/Applications/lua/lua: -8.58% (31.0707 => 28.4056, std.dev.: 1.0265)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.53% (1.7207 => 1.6256, std.dev.: 0.0238)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.36% (47.2250 => 44.6924, std.dev.: 0.2002)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.75% (3.8119 => 3.6307, std.dev.: 0.0087)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -4.00% (0.4969 => 0.4770, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/fbench: -3.58% (4.9602 => 4.7824, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.30% (6.0444 => 5.8447, std.dev.: 0.0359)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -3.20% (4.2062 => 4.0716, std.dev.: 0.0439)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.85% (2.7049 => 2.6278, std.dev.: 0.0269)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (41.0210 => 39.9125, std.dev.: 0.3630)
  SingleSource/Regression/C/uint64_to_float: -2.52% (1.5184 => 1.4802, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.32% (4.9231 => 4.8583, std.dev.: 0.0031)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.28% (34.8438 => 34.3977, std.dev.: 0.0556)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.73% (0.1378 => 0.1368, std.dev.: 0.0072)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130802/969d7d3b/attachment.html>


More information about the llvm-testresults mailing list