[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 26 09:26:48 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14805?compare_to=14801&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14805, Order: 189215, Start Time: 2013-08-26 14:35:24, End Time: 2013-08-26 16:29:02
      To: 14801, Order: 189214, Start Time: 2013-08-26 12:25:43, End Time: 2013-08-26 14:10:59
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 51 (61 on baseline)
Performance Improvements: 2 (24 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1054 (1022 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-05-02-DependentPHI: 78.70% (0.0169 => 0.0302, std.dev.: 0.0008)
  SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 73.10% (0.0171 => 0.0296, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/build2: 69.40% (0.0366 => 0.0620, std.dev.: 0.0039)
  SingleSource/UnitTests/Vector/divides: 67.20% (0.0189 => 0.0316, std.dev.: 0.0015)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 62.76% (0.0572 => 0.0931, std.dev.: 0.0073)
  SingleSource/UnitTests/initp1: 62.55% (0.0502 => 0.0816, std.dev.: 0.0013)
  SingleSource/UnitTests/stmtexpr: 61.65% (0.0206 => 0.0333, std.dev.: 0.0023)
  MultiSource/Benchmarks/Olden/tsp/tsp: 59.47% (0.1389 => 0.2215, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout/strcat: 52.60% (0.0308 => 0.0470, std.dev.: 0.0023)
  SingleSource/UnitTests/SignlessTypes/div: 45.27% (0.0349 => 0.0507, std.dev.: 0.0031)
  SingleSource/UnitTests/Vector/constpool: 42.56% (8.7577 => 12.4854, std.dev.: 0.4920)
  MultiSource/Applications/JM/ldecod/ldecod: 20.47% (7.7473 => 9.3332, std.dev.: 0.1534)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.74% (1.4337 => 1.6594, std.dev.: 0.0800)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 12.42% (1.4046 => 1.5791, std.dev.: 0.0309)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.68% (1.4129 => 1.5779, std.dev.: 0.0193)
  MultiSource/Applications/oggenc/oggenc: 11.52% (5.7729 => 6.4377, std.dev.: 0.0941)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 11.40% (0.1149 => 0.1280, std.dev.: 0.0029)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 11.22% (0.4197 => 0.4668, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.04% (1.4649 => 1.6266, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.79% (1.4908 => 1.6517, std.dev.: 0.0438)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.76% (1.3722 => 1.5198, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.27% (1.4123 => 1.5573, std.dev.: 0.0165)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.01% (2.5317 => 2.7850, std.dev.: 0.0640)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.72% (1.4965 => 1.6270, std.dev.: 0.0236)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 8.15% (0.1841 => 0.1991, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.05% (1.4652 => 1.5831, std.dev.: 0.0213)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.58% (1.5126 => 1.6273, std.dev.: 0.0312)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.79% (1.4863 => 1.5872, std.dev.: 0.0386)
  MultiSource/Benchmarks/nbench/nbench: 3.26% (1.3250 => 1.3682, std.dev.: 0.0088)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 68.49% (2.9026 => 4.8907, std.dev.: 0.1342)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 41.66% (1.7173 => 2.4328, std.dev.: 0.1498)
  MultiSource/Applications/SPASS/SPASS: 33.74% (8.0270 => 10.7354, std.dev.: 0.5051)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 29.44% (1.4777 => 1.9128, std.dev.: 0.0205)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 21.04% (29.3368 => 35.5084, std.dev.: 0.1380)
  SingleSource/Benchmarks/Shootout-C++/fibo: 13.58% (4.1402 => 4.7023, std.dev.: 0.0723)
  SingleSource/Benchmarks/Shootout/strcat: 10.61% (0.1471 => 0.1627, std.dev.: 0.0053)
  MultiSource/Applications/oggenc/oggenc: 9.91% (0.1665 => 0.1830, std.dev.: 0.0050)
  MultiSource/Benchmarks/Olden/em3d/em3d: 7.41% (4.8198 => 5.1768, std.dev.: 0.0130)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 6.85% (39.9165 => 42.6509, std.dev.: 0.2777)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.18% (90.5439 => 95.2366, std.dev.: 1.1779)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 4.87% (1.4294 => 1.4990, std.dev.: 0.0077)
  SingleSource/Benchmarks/Misc/flops: 4.42% (9.4178 => 9.8339, std.dev.: 0.0231)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 3.94% (20.8617 => 21.6838, std.dev.: 0.1613)
  SingleSource/Regression/C/uint64_to_float: 3.77% (1.4439 => 1.4984, std.dev.: 0.0122)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.14% (1.6326 => 1.6676, std.dev.: 0.0130)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.10% (3.5488 => 3.6234, std.dev.: 0.0134)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.98% (2.8170 => 2.8727, std.dev.: 0.0146)
  MultiSource/Benchmarks/llubenchmark/llu: 1.60% (1.9968 => 2.0287, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.22% (16.2958 => 16.4950, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.03% (5.8015 => 5.8611, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.02% (5.9471 => 6.0078, std.dev.: 0.0191)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: -3.06% (1.8360 => 1.7798, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc/ReedSolomon: -3.02% (8.6783 => 8.4158, std.dev.: 0.0171)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.23% (0.1301 => 0.1356, std.dev.: 0.0112)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 108.45% (0.0142 => 0.0296, std.dev.: 0.0002)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 87.58% (0.0161 => 0.0302, std.dev.: 0.0008)
  SingleSource/UnitTests/stmtexpr: 69.04% (0.0197 => 0.0333, std.dev.: 0.0023)
  SingleSource/UnitTests/initp1: 64.19% (0.0497 => 0.0816, std.dev.: 0.0013)
  SingleSource/UnitTests/Vector/build2: 63.16% (0.0380 => 0.0620, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout/strcat: 60.96% (0.0292 => 0.0470, std.dev.: 0.0023)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 60.52% (0.0580 => 0.0931, std.dev.: 0.0073)
  SingleSource/UnitTests/Vector/divides: 59.60% (0.0198 => 0.0316, std.dev.: 0.0015)
  SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0338 => 0.0507, std.dev.: 0.0031)
  SingleSource/UnitTests/Vector/constpool: 40.87% (8.8630 => 12.4854, std.dev.: 0.4920)
  MultiSource/Benchmarks/Olden/tsp/tsp: 21.84% (0.1818 => 0.2215, std.dev.: 0.0054)
  MultiSource/Benchmarks/FreeBench/distray/distray: 19.07% (0.1033 => 0.1230, std.dev.: 0.0026)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 11.62% (0.4182 => 0.4668, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.98% (1.3946 => 1.5198, std.dev.: 0.0139)
  MultiSource/Applications/JM/ldecod/ldecod: 7.62% (8.6720 => 9.3332, std.dev.: 0.1534)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.27% (1.4721 => 1.5791, std.dev.: 0.0309)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.22% (0.5292 => 0.5674, std.dev.: 0.0140)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.87% (0.1863 => 0.1991, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.89% (1.5361 => 1.6266, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.56% (1.5416 => 1.6273, std.dev.: 0.0312)
  MultiSource/Applications/oggenc/oggenc: 5.33% (6.1121 => 6.4377, std.dev.: 0.0941)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 5.11% (1.5479 => 1.6270, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.85% (1.4853 => 1.5573, std.dev.: 0.0165)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.19% (1.5144 => 1.5779, std.dev.: 0.0193)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 72.89% (3.7285 => 6.4462, std.dev.: 0.1302)
  SingleSource/Benchmarks/Shootout/heapsort: 67.93% (2.9123 => 4.8907, std.dev.: 0.1342)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 50.91% (1.6121 => 2.4328, std.dev.: 0.1498)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.64% (2.8867 => 4.2908, std.dev.: 0.0345)
  MultiSource/Benchmarks/FreeBench/neural/neural: 38.63% (0.3171 => 0.4396, std.dev.: 0.0397)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 27.84% (2.9428 => 3.7622, std.dev.: 0.2980)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.27% (1.5030 => 1.9128, std.dev.: 0.0205)
  SingleSource/Benchmarks/Shootout/hash: 25.62% (4.1846 => 5.2565, std.dev.: 0.3274)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 23.76% (0.0526 => 0.0651, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 19.10% (29.8131 => 35.5084, std.dev.: 0.1380)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.54% (0.6295 => 0.7336, std.dev.: 0.0316)
  MultiSource/Applications/SPASS/SPASS: 16.41% (9.2220 => 10.7354, std.dev.: 0.5051)
  MultiSource/Applications/JM/lencod/lencod: 12.63% (7.1799 => 8.0865, std.dev.: 0.2423)
  MultiSource/Benchmarks/Olden/tsp/tsp: 11.25% (1.5339 => 1.7064, std.dev.: 0.0521)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.07% (7.0762 => 7.8596, std.dev.: 0.1133)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.71% (0.1678 => 0.1841, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.41% (5.4910 => 6.0078, std.dev.: 0.0191)
  MultiSource/Applications/oggenc/oggenc: 8.28% (0.1690 => 0.1830, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.33% (3.2027 => 3.4375, std.dev.: 0.0255)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.90% (48.3256 => 51.6599, std.dev.: 0.2732)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.55% (5.5008 => 5.8611, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.12% (5.3042 => 5.6287, std.dev.: 0.0625)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.15% (4.3151 => 4.5374, std.dev.: 0.0092)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 4.63% (1.4327 => 1.4990, std.dev.: 0.0077)
  SingleSource/Benchmarks/Misc/whetstone: 4.44% (3.4559 => 3.6094, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3658, std.dev.: 0.0335)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.97% (41.0210 => 42.6509, std.dev.: 0.2777)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.77% (3.3384 => 3.4642, std.dev.: 0.0457)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.31% (25.0200 => 25.8473, std.dev.: 0.0535)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.04% (4.8739 => 5.0223, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout/matrix: 2.53% (1.7358 => 1.7798, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.46% (12.8625 => 13.1786, std.dev.: 0.0711)
  SingleSource/Benchmarks/Misc/ffbench: 2.19% (1.3679 => 1.3979, std.dev.: 0.0020)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 2.03% (2.8156 => 2.8727, std.dev.: 0.0146)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.02% (3.5516 => 3.6234, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.57% (3.0680 => 3.1163, std.dev.: 0.0044)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.37% (1.1618 => 1.1777, std.dev.: 0.0009)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.62% (0.2237 => 0.1485, std.dev.: 0.0285)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -35.27% (1.4194 => 0.9188, std.dev.: 0.0953)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.37% (2.1022 => 1.4217, std.dev.: 0.0091)
  MultiSource/Applications/viterbi/viterbi: -26.83% (3.4923 => 2.5553, std.dev.: 0.0129)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -26.35% (0.0816 => 0.0601, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.59% (6.9552 => 5.2447, std.dev.: 0.0234)
  SingleSource/Benchmarks/Misc/perlin: -21.31% (4.5989 => 3.6189, std.dev.: 0.1008)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -19.80% (0.0884 => 0.0709, std.dev.: 0.0035)
  MultiSource/Applications/JM/ldecod/ldecod: -19.67% (0.0859 => 0.0690, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/mandel: -13.87% (1.1996 => 1.0332, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.38% (6.2627 => 5.5499, std.dev.: 0.1606)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.66% (47.2250 => 44.5525, std.dev.: 0.1418)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.73% (3.8119 => 3.6316, std.dev.: 0.0241)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.05% (0.7355 => 0.7057, std.dev.: 0.0021)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.97% (1.1032 => 1.0594, std.dev.: 0.0166)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.09% (1.7207 => 1.6676, std.dev.: 0.0130)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.06% (0.7806 => 0.7567, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.02% (6.0444 => 5.8616, std.dev.: 0.0348)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.92% (5.2218 => 5.0693, std.dev.: 0.0435)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.34% (8.6172 => 8.4158, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.11% (6.1482 => 6.0185, std.dev.: 0.0202)
  SingleSource/Benchmarks/Misc/oourafft: -1.95% (3.7891 => 3.7154, std.dev.: 0.0258)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.72% (34.8438 => 34.2453, std.dev.: 0.0649)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.19% (4.4805 => 4.4274, std.dev.: 0.0186)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.60% (0.1378 => 0.1356, std.dev.: 0.0112)

Report Time: 0.93s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130826/5aa22330/attachment.html>


More information about the llvm-testresults mailing list