[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Tue Sep 24 14:08:24 PDT 2013

http://llvm.org/perf/db_default/v4/nts/15627?compare_to=15623&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15627, Order: 191325, Start Time: 2013-09-24 19:19:23, End Time: 2013-09-24 21:11:09
      To: 15623, Order: 191308, Start Time: 2013-09-24 16:59:10, End Time: 2013-09-24 18:53:47
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 26 (41 on baseline)
Performance Improvements: 38 (14 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1043 (1052 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/siod/siod: 15.23% (2.5399 => 2.9267, std.dev.: 0.0497)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.47% (0.9026 => 1.0061, std.dev.: 0.0251)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.34% (0.6420 => 0.7084, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.28% (1.3865 => 1.5151, std.dev.: 0.0356)
  SingleSource/Benchmarks/Shootout-C++/ary: 8.26% (0.2506 => 0.2713, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.97% (1.3164 => 1.3423, std.dev.: 0.0052)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 54.55% (7.9850 => 12.3407, std.dev.: 0.1299)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 39.06% (1.7547 => 2.4400, std.dev.: 0.1259)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 33.69% (0.1478 => 0.1976, std.dev.: 0.0131)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 33.36% (4.8865 => 6.5165, std.dev.: 0.0751)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 31.04% (3.5653 => 4.6719, std.dev.: 0.0711)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 15.90% (40.8085 => 47.2981, std.dev.: 0.6655)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.05% (1.1051 => 1.2162, std.dev.: 0.0071)
  MultiSource/Applications/sgefa/sgefa: 8.58% (0.8376 => 0.9095, std.dev.: 0.0044)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 7.40% (2.2955 => 2.4654, std.dev.: 0.0040)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.14% (8.1447 => 8.6444, std.dev.: 0.0473)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 5.76% (0.4582 => 0.4846, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.77% (4.8038 => 5.0328, std.dev.: 0.0090)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.64% (1.2913 => 1.3512, std.dev.: 0.0014)
  MultiSource/Applications/spiff/spiff: 3.50% (2.8456 => 2.9452, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.64% (5.7144 => 5.8655, std.dev.: 0.0127)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.22% (2.4924 => 2.5477, std.dev.: 0.0094)
  SingleSource/Benchmarks/Misc/flops: 2.18% (9.3746 => 9.5791, std.dev.: 0.0192)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.01% (2.4875 => 2.5375, std.dev.: 0.0174)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.40% (16.6386 => 16.8723, std.dev.: 0.0210)
  SingleSource/Benchmarks/Misc/richards_benchmark: 1.31% (1.4136 => 1.4321, std.dev.: 0.0051)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Threads/2010-12-08-tls: -48.24% (0.0313 => 0.0162, std.dev.: 0.0050)
  SingleSource/UnitTests/2008-04-18-LoopBug: -47.47% (0.0316 => 0.0166, std.dev.: 0.0031)
  SingleSource/UnitTests/stmtexpr: -44.72% (0.0360 => 0.0199, std.dev.: 0.0012)
  SingleSource/UnitTests/2003-05-02-DependentPHI: -44.14% (0.0290 => 0.0162, std.dev.: 0.0019)
  SingleSource/UnitTests/2003-09-18-BitFieldTest: -41.96% (0.0286 => 0.0166, std.dev.: 0.0044)
  SingleSource/UnitTests/SignlessTypes/ccc: -41.85% (0.0454 => 0.0264, std.dev.: 0.0070)
  SingleSource/UnitTests/conditional-gnu-ext-cxx: -41.69% (0.0295 => 0.0172, std.dev.: 0.0011)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -39.73% (0.3111 => 0.1875, std.dev.: 0.0101)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -31.11% (0.0736 => 0.0507, std.dev.: 0.0016)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -26.58% (0.1174 => 0.0862, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout/matrix: -23.82% (0.1100 => 0.0838, std.dev.: 0.0028)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.55% (1.4962 => 1.1888, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -18.37% (0.7078 => 0.5778, std.dev.: 0.0232)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -18.23% (0.0927 => 0.0758, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -17.67% (0.8617 => 0.7094, std.dev.: 0.0351)
  MultiSource/Benchmarks/Olden/health/health: -15.15% (0.1828 => 0.1551, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -14.71% (0.4622 => 0.3942, std.dev.: 0.0133)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -13.81% (1.8867 => 1.6261, std.dev.: 0.0608)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -11.04% (1.4982 => 1.3328, std.dev.: 0.0161)
  SingleSource/Benchmarks/Shootout-C++/strcat: -10.01% (0.2287 => 0.2058, std.dev.: 0.0087)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -9.84% (27.8482 => 25.1091, std.dev.: 0.8368)
  SingleSource/Benchmarks/Stanford/Puzzle: -9.32% (0.1448 => 0.1313, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -8.95% (1.6289 => 1.4831, std.dev.: 0.0208)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -8.46% (0.3097 => 0.2835, std.dev.: 0.0080)
  MultiSource/Applications/lua/lua: -7.41% (4.6769 => 4.3302, std.dev.: 0.0902)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -5.25% (1.2365 => 1.1716, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.60% (1.3243 => 1.2766, std.dev.: 0.0127)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: -45.00% (0.0240 => 0.0132, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/bisort/bisort: -31.47% (0.9936 => 0.6809, std.dev.: 0.0337)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -27.38% (0.0705 => 0.0512, std.dev.: 0.0001)
  MultiSource/Applications/JM/ldecod/ldecod: -22.74% (0.0853 => 0.0659, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/health/health: -11.14% (0.3787 => 0.3365, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/strcat: -10.88% (0.1075 => 0.0958, std.dev.: 0.0001)
  MultiSource/Benchmarks/FreeBench/mason/mason: -6.76% (0.3179 => 0.2964, std.dev.: 0.0007)
  MultiSource/Benchmarks/Olden/tsp/tsp: -5.11% (1.6407 => 1.5569, std.dev.: 0.0080)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.90% (0.3347 => 0.3183, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.50% (4.2266 => 4.1208, std.dev.: 0.0362)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.69% (8.6390 => 8.4928, std.dev.: 0.0566)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.41% (0.1372 => 0.1339, std.dev.: 0.0024)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Dhrystone/dry: 36.01% (0.0572 => 0.0778, std.dev.: 0.0080)
  MultiSource/Applications/siod/siod: 19.55% (2.4480 => 2.9267, std.dev.: 0.0497)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.10% (1.2639 => 1.4927, std.dev.: 0.0817)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.48% (1.3235 => 1.5151, std.dev.: 0.0356)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.30% (0.8802 => 1.0061, std.dev.: 0.0251)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 12.93% (0.0820 => 0.0926, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.50% (0.6297 => 0.7084, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 11.57% (1.2660 => 1.4125, std.dev.: 0.0309)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.69% (0.1254 => 0.1388, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/ary: 9.66% (0.2474 => 0.2713, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.76% (1.2630 => 1.3737, std.dev.: 0.0373)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 7.48% (0.1470 => 0.1580, std.dev.: 0.0042)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.34% (1.1393 => 1.1888, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.67% (1.2948 => 1.3423, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.89% (1.2250 => 1.2604, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.51% (1.3042 => 1.3370, std.dev.: 0.0062)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 61.47% (7.6426 => 12.3407, std.dev.: 0.1299)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 55.16% (3.0111 => 4.6719, std.dev.: 0.0711)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 43.29% (4.5479 => 6.5165, std.dev.: 0.0751)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 41.89% (1.7197 => 2.4400, std.dev.: 0.1259)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.56% (0.1374 => 0.1629, std.dev.: 0.0002)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 16.62% (40.5588 => 47.2981, std.dev.: 0.6655)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.43% (1.1013 => 1.2162, std.dev.: 0.0071)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.96% (1.2516 => 1.3512, std.dev.: 0.0014)
  SingleSource/UnitTests/Vector/multiplies: 6.78% (0.5561 => 0.5938, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.63% (4.5744 => 4.8776, std.dev.: 0.0395)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.27% (8.1346 => 8.6444, std.dev.: 0.0473)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 5.52% (2.3365 => 2.4654, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.64% (4.1011 => 4.2912, std.dev.: 0.0257)
  MultiSource/Applications/spiff/spiff: 4.46% (2.8194 => 2.9452, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.99% (5.6951 => 5.8655, std.dev.: 0.0127)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.89% (1.4898 => 1.5328, std.dev.: 0.0163)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.66% (4.9022 => 5.0328, std.dev.: 0.0090)
  MultiSource/Benchmarks/Olden/power/power: 2.40% (1.2170 => 1.2462, std.dev.: 0.0001)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.24% (2.4920 => 2.5477, std.dev.: 0.0094)
  SingleSource/Benchmarks/Misc/richards_benchmark: 2.21% (1.4012 => 1.4321, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.17% (3.1569 => 3.2253, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout/methcall: 1.81% (8.5434 => 8.6983, std.dev.: 0.0328)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.55% (16.7972 => 17.0577, std.dev.: 0.0088)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (1.6707 => 1.6949, std.dev.: 0.0083)
  SingleSource/Benchmarks/Misc/flops: 1.44% (9.4433 => 9.5791, std.dev.: 0.0192)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.01% (0.5226 => 0.2351, std.dev.: 0.0216)
  MultiSource/Applications/sgefa/sgefa: -42.40% (1.5790 => 0.9095, std.dev.: 0.0044)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.76% (57.2347 => 43.6358, std.dev.: 3.9673)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.19% (15.9508 => 12.8897, std.dev.: 0.5053)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -12.61% (20.8247 => 18.1986, std.dev.: 0.2088)
  MultiSource/Benchmarks/FreeBench/mason/mason: -10.29% (0.3304 => 0.2964, std.dev.: 0.0007)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.42% (50.0284 => 46.3180, std.dev.: 0.3058)
  MultiSource/Applications/JM/lencod/lencod: -4.89% (8.1785 => 7.7787, std.dev.: 0.1206)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.02% (2.5938 => 2.4894, std.dev.: 0.0048)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.01% (4.3592 => 4.1846, std.dev.: 0.0193)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.66% (2.4471 => 2.3821, std.dev.: 0.0175)
  SingleSource/Benchmarks/Shootout/sieve: -2.16% (7.2254 => 7.0695, std.dev.: 0.0276)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.58% (17.1431 => 16.8723, std.dev.: 0.0210)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.27% (89.7126 => 88.5700, std.dev.: 0.2834)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.67% (0.1348 => 0.1339, std.dev.: 0.0024)

Report Time: 1.16s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130924/94a8a4ed/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results