[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Aug 22 04:16:54 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14670?compare_to=14666&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14670, Order: 188993, Start Time: 2013-08-22 09:27:03, End Time: 2013-08-22 11:19:01
      To: 14666, Order: 188989, Start Time: 2013-08-22 07:14:59, End Time: 2013-08-22 09:05:09
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 20 (49 on baseline)
Performance Improvements: 3 (36 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1084 (1022 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 67.14% (0.0639 => 0.1068, std.dev.: 0.0048)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 16.05% (2.6816 => 3.1119, std.dev.: 0.0795)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.19% (4.2852 => 4.8503, std.dev.: 0.1592)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.51% (0.3641 => 0.4060, std.dev.: 0.0123)
  SingleSource/Benchmarks/Shootout-C++/lists: 10.22% (0.2895 => 0.3191, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 8.17% (0.2437 => 0.2636, std.dev.: 0.0030)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 75.59% (2.9033 => 5.0980, std.dev.: 0.0818)
  SingleSource/Benchmarks/Shootout/ary3: 65.82% (5.7900 => 9.6007, std.dev.: 1.0299)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.36% (36.8787 => 42.9136, std.dev.: 1.5868)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.47% (40.6373 => 46.5181, std.dev.: 2.2235)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 13.09% (1.0728 => 1.2132, std.dev.: 0.0142)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 8.43% (3.9834 => 4.3191, std.dev.: 0.0418)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 8.10% (0.2703 => 0.2922, std.dev.: 0.0064)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.45% (14.9838 => 15.9506, std.dev.: 0.3275)
  SingleSource/Benchmarks/Misc/ffbench: 5.44% (1.3834 => 1.4586, std.dev.: 0.0073)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.80% (1.4273 => 1.4673, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.71% (3.4833 => 3.5777, std.dev.: 0.0348)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.77% (2.5490 => 2.5942, std.dev.: 0.0030)
  SingleSource/Regression/C/uint64_to_float: 1.54% (1.4553 => 1.4777, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/whetstone: 1.10% (3.5700 => 3.6094, std.dev.: 0.0045)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/hbd/hbd: -18.81% (2.0946 => 1.7007, std.dev.: 0.0583)
  MultiSource/Applications/Burg/burg: -6.09% (1.5836 => 1.4871, std.dev.: 0.0108)
  MultiSource/Applications/sgefa/sgefa: -5.34% (0.4439 => 0.4202, std.dev.: 0.0056)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.04% (0.1349 => 0.1308, std.dev.: 0.0255)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-04-20-LoopBug2: 143.06% (0.0072 => 0.0175, std.dev.: 0.0008)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 68.72% (0.0633 => 0.1068, std.dev.: 0.0048)
  SingleSource/Regression/C/bigstack: 42.27% (0.0466 => 0.0663, std.dev.: 0.0020)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 17.92% (2.6390 => 3.1119, std.dev.: 0.0795)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.81% (0.0844 => 0.0969, std.dev.: 0.0003)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.28% (4.2444 => 4.8503, std.dev.: 0.1592)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.03% (0.3592 => 0.4060, std.dev.: 0.0123)
  SingleSource/Benchmarks/Shootout-C++/lists: 11.69% (0.2857 => 0.3191, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 9.88% (0.2399 => 0.2636, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.87% (6.4979 => 7.0744, std.dev.: 0.2192)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.45% (0.6785 => 0.7019, std.dev.: 0.0055)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.75% (0.7010 => 0.7133, std.dev.: 0.0040)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 75.59% (2.9033 => 5.0980, std.dev.: 0.0818)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 75.05% (3.7285 => 6.5267, std.dev.: 0.0276)
  SingleSource/Benchmarks/Shootout/ary3: 65.08% (5.8158 => 9.6007, std.dev.: 1.0299)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.62% (2.8867 => 4.3192, std.dev.: 0.0152)
  MultiSource/Benchmarks/FreeBench/neural/neural: 36.46% (0.3171 => 0.4327, std.dev.: 0.0356)
  SingleSource/Benchmarks/Misc/pi: 28.08% (1.9835 => 2.5404, std.dev.: 0.0135)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 27.82% (2.9428 => 3.7616, std.dev.: 0.2568)
  SingleSource/Benchmarks/Shootout/hash: 27.75% (4.1846 => 5.3457, std.dev.: 0.2645)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.33% (36.8900 => 42.9136, std.dev.: 1.5868)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.85% (40.5028 => 46.5181, std.dev.: 2.2235)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.85% (7.0762 => 7.8440, std.dev.: 0.0198)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.65% (1.0964 => 1.2132, std.dev.: 0.0142)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 9.07% (0.2679 => 0.2922, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.33% (5.4910 => 5.9485, std.dev.: 0.0265)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.11% (48.3256 => 52.2439, std.dev.: 0.3664)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 8.04% (3.9978 => 4.3191, std.dev.: 0.0418)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.92% (1.2557 => 1.3552, std.dev.: 0.0217)
  MultiSource/Applications/JM/lencod/lencod: 7.78% (7.1799 => 7.7383, std.dev.: 0.1582)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.15% (2.3304 => 2.4971, std.dev.: 0.0207)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.74% (3.2027 => 3.4187, std.dev.: 0.0139)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.63% (14.9584 => 15.9506, std.dev.: 0.3275)
  SingleSource/Benchmarks/Misc/ffbench: 6.63% (1.3679 => 1.4586, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6218, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.68% (3.4085 => 3.6022, std.dev.: 0.0368)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.61% (3.3877 => 3.5777, std.dev.: 0.0348)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.43% (5.5008 => 5.7997, std.dev.: 0.0018)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.93% (2.3894 => 2.5072, std.dev.: 0.0261)
  SingleSource/Benchmarks/Misc/whetstone: 4.44% (3.4559 => 3.6094, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.28% (4.3151 => 4.5000, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.26% (5.1471 => 5.3662, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.04% (6.1245 => 6.3719, std.dev.: 0.0575)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.67% (3.3384 => 3.4610, std.dev.: 0.0436)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.29% (25.0200 => 25.8429, std.dev.: 0.0272)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.95% (3.3464 => 3.4451, std.dev.: 0.0298)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.3104 => 1.3426, std.dev.: 0.0111)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.19% (2.5636 => 2.5942, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.16% (11.5371 => 11.6707, std.dev.: 0.0194)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -31.16% (0.1072 => 0.0738, std.dev.: 0.0047)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -17.52% (0.1518 => 0.1252, std.dev.: 0.0017)
  MultiSource/Applications/hbd/hbd: -15.78% (2.0193 => 1.7007, std.dev.: 0.0583)
  MultiSource/Applications/sgefa/sgefa: -12.62% (0.4809 => 0.4202, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.14% (1.5144 => 1.4062, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.07% (1.5426 => 1.4336, std.dev.: 0.0372)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.39% (1.4794 => 1.3849, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.64% (1.5437 => 1.4566, std.dev.: 0.0184)
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.64% (2.6853 => 2.5338, std.dev.: 0.0224)
  MultiSource/Applications/Burg/burg: -5.48% (1.5733 => 1.4871, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.97% (1.4721 => 1.3989, std.dev.: 0.0228)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.05% (0.3309 => 0.3208, std.dev.: 0.0009)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -30.20% (2.1022 => 1.4673, std.dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.02% (0.0816 => 0.0571, std.dev.: 0.0004)
  MultiSource/Applications/lemon/lemon: -29.34% (1.4194 => 1.0030, std.dev.: 0.1486)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.68% (0.1189 => 0.0848, std.dev.: 0.0119)
  MultiSource/Applications/viterbi/viterbi: -27.37% (3.4923 => 2.5363, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.63% (6.9552 => 5.2420, std.dev.: 0.0520)
  SingleSource/Benchmarks/Misc/perlin: -20.86% (4.5989 => 3.6396, std.dev.: 0.0567)
  SingleSource/Benchmarks/Misc/mandel: -13.46% (1.1996 => 1.0381, std.dev.: 0.0457)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.24% (0.0956 => 0.0839, std.dev.: 0.0022)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.79% (3.5791 => 3.3362, std.dev.: 0.0458)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.85% (3.8119 => 3.6270, std.dev.: 0.0674)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -4.35% (0.4969 => 0.4753, std.dev.: 0.0050)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.06% (2.7049 => 2.5952, std.dev.: 0.0329)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.74% (21.6864 => 20.8753, std.dev.: 0.2525)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.45% (1.7207 => 1.6613, std.dev.: 0.0181)
  SingleSource/Benchmarks/Misc/fbench: -3.43% (4.9602 => 4.7899, std.dev.: 0.0388)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -2.86% (0.4783 => 0.4646, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.83% (5.2218 => 5.0740, std.dev.: 0.0192)
  SingleSource/Regression/C/uint64_to_float: -2.68% (1.5184 => 1.4777, std.dev.: 0.0024)
  MultiSource/Applications/sgefa/sgefa: -2.44% (1.4030 => 1.3688, std.dev.: 0.0010)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.78% (5.6678 => 5.5670, std.dev.: 0.0380)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.73% (34.8438 => 34.2396, std.dev.: 0.0521)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.43% (5.8810 => 5.7967, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.35% (4.9231 => 4.8564, std.dev.: 0.0129)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.08% (0.1378 => 0.1308, std.dev.: 0.0255)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130822/693db757/attachment.html>


More information about the llvm-testresults mailing list