[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Aug 2 19:51:53 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14048?compare_to=14046&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14048, Order: 187689, Start Time: 2013-08-03 01:07:15, End Time: 2013-08-03 02:53:41
      To: 14046, Order: 187678, Start Time: 2013-08-02 22:57:24, End Time: 2013-08-03 00:46:03
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 3 (31 on baseline)
Performance Improvements: 15 (73 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1087 (1001 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 10.70% (1.8967 => 2.0997, std.dev.: 0.0750)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 6.66% (4.0710 => 4.3423, std.dev.: 0.0130)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.65% (15.8653 => 16.7616, std.dev.: 0.0732)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vectorizer/gcc-loops: -7.67% (0.6104 => 0.5636, std.dev.: 0.0060)
  SingleSource/UnitTests/Vector/constpool: -7.44% (9.4145 => 8.7145, std.dev.: 0.1148)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -5.91% (0.2252 => 0.2119, std.dev.: 0.0008)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.04% (0.2123 => 0.2016, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -3.34% (0.3713 => 0.3589, std.dev.: 0.0023)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -2.68% (0.4327 => 0.4211, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.27% (1.0085 => 0.9856, std.dev.: 0.0014)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -16.93% (0.0951 => 0.0790, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -14.51% (0.2226 => 0.1903, std.dev.: 0.0097)
  SingleSource/Benchmarks/Shootout-C++/lists1: -9.74% (0.6624 => 0.5979, std.dev.: 0.0108)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -9.22% (3.6282 => 3.2935, std.dev.: 0.0974)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.14% (1.5392 => 1.4908, std.dev.: 0.0030)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.08% (30.1686 => 29.2406, std.dev.: 0.2245)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.79% (4.6314 => 4.5020, std.dev.: 0.0092)
  SingleSource/Benchmarks/Shootout/hash: -1.18% (5.2753 => 5.2128, std.dev.: 0.0224)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: -1.35% (0.1333 => 0.1315, std.dev.: 0.0381)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.28% (0.2676 => 0.2737, std.dev.: 0.0513)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0279 => 0.0279, std.dev.: 0.0000)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.70% (0.2813 => 0.2737, std.dev.: 0.0513)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.13% (0.0345 => 0.0279, std.dev.: 0.0000)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 41.20% (0.0466 => 0.0658, std.dev.: 0.0003)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.71% (3.7285 => 6.4766, std.dev.: 0.0446)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.41% (2.8867 => 4.2842, std.dev.: 0.0054)
  MultiSource/Benchmarks/FreeBench/neural/neural: 38.22% (0.3171 => 0.4383, std.dev.: 0.0357)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.88% (1.5030 => 1.8769, std.dev.: 0.0101)
  SingleSource/Benchmarks/Shootout/hash: 24.57% (4.1846 => 5.2128, std.dev.: 0.0224)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.14% (0.6295 => 0.7311, std.dev.: 0.0162)
  MultiSource/Applications/siod/siod: 13.78% (3.3761 => 3.8412, std.dev.: 0.0530)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.91% (7.0762 => 7.9895, std.dev.: 0.0075)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.05% (14.9584 => 16.7616, std.dev.: 0.0732)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 11.92% (2.9428 => 3.2935, std.dev.: 0.0974)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.31% (5.4910 => 5.9474, std.dev.: 0.0380)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.60% (3.2027 => 3.4461, std.dev.: 0.0312)
  SingleSource/Benchmarks/McGill/chomp: 7.30% (1.0051 => 1.0785, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.92% (5.3042 => 5.6180, std.dev.: 0.0061)
  SingleSource/Benchmarks/Linpack/linpack-pc: 5.84% (48.3256 => 51.1472, std.dev.: 0.5888)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.75% (3.3877 => 3.5824, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.65% (3.4085 => 3.6011, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.52% (5.5008 => 5.8046, std.dev.: 0.1150)
  MultiSource/Benchmarks/Olden/tsp/tsp: 5.36% (1.5339 => 1.6161, std.dev.: 0.0284)
  SingleSource/Benchmarks/Misc/whetstone: 4.40% (3.4559 => 3.6079, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.27% (5.1471 => 5.3669, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.79% (3.3384 => 3.4650, std.dev.: 0.0069)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (4.2062 => 4.3423, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.00% (4.8739 => 5.0203, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.39% (12.8625 => 13.1694, std.dev.: 0.0276)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.12% (4.4624 => 4.5571, std.dev.: 0.0172)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.06% (1.5957 => 1.6286, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout/matrix: 2.03% (1.7358 => 1.7711, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/flops: 1.61% (9.7664 => 9.9238, std.dev.: 0.0322)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.60% (1.5956 => 1.6211, std.dev.: 0.0058)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -34.91% (0.2237 => 0.1456, std.dev.: 0.0071)
  MultiSource/Benchmarks/Olden/bisort/bisort: -34.51% (0.1072 => 0.0702, std.dev.: 0.0070)
  MultiSource/Benchmarks/Olden/tsp/tsp: -24.31% (0.1818 => 0.1376, std.dev.: 0.0114)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.71% (6.0938 => 4.7100, std.dev.: 0.4877)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -21.63% (0.0675 => 0.0529, std.dev.: 0.0053)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.64% (1.5228 => 1.2085, std.dev.: 0.0049)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -19.16% (0.3576 => 0.2891, std.dev.: 0.0079)
  MultiSource/Applications/obsequi/Obsequi: -18.89% (1.4685 => 1.1911, std.dev.: 0.0946)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -18.12% (0.1518 => 0.1243, std.dev.: 0.0006)
  MultiSource/Applications/hbd/hbd: -17.10% (2.0193 => 1.6741, std.dev.: 0.0780)
  MultiSource/Applications/lua/lua: -17.08% (5.3200 => 4.4114, std.dev.: 0.0602)
  MultiSource/Applications/hexxagon/hexxagon: -16.48% (1.3285 => 1.1096, std.dev.: 0.0229)
  MultiSource/Benchmarks/Olden/em3d/em3d: -14.53% (0.2367 => 0.2023, std.dev.: 0.0096)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.75% (1.3985 => 1.2062, std.dev.: 0.0204)
  MultiSource/Applications/lambda-0_1_3/lambda: -11.57% (0.9461 => 0.8366, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.25% (1.5144 => 1.4046, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.68% (1.5815 => 1.4758, std.dev.: 0.0056)
  MultiSource/Benchmarks/PAQ8p/paq8p: -6.48% (2.6853 => 2.5112, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.48% (1.6226 => 1.5175, std.dev.: 0.0151)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.43% (1.4794 => 1.3843, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.02% (1.5426 => 1.4498, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.77% (1.5437 => 1.4546, std.dev.: 0.0070)
  MultiSource/Benchmarks/Olden/bh/bh: -5.66% (0.3603 => 0.3399, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.48% (1.4333 => 1.3547, std.dev.: 0.0075)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.48% (6.1631 => 5.8256, std.dev.: 0.1100)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.22% (1.4166 => 1.3426, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.12% (1.4506 => 1.3763, std.dev.: 0.0111)
  MultiSource/Applications/minisat/minisat: -5.00% (0.8278 => 0.7864, std.dev.: 0.0135)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.62% (27.6418 => 26.3636, std.dev.: 0.3370)
  MultiSource/Benchmarks/Bullet/bullet: -3.66% (37.4863 => 36.1159, std.dev.: 0.1385)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -3.47% (49.1253 => 47.4187, std.dev.: 0.5295)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.23% (1.5376 => 1.4879, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.32% (1.4037 => 1.3712, std.dev.: 0.0081)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: -90.99% (0.0111 => 0.0010, std.dev.: 0.0007)
  MultiSource/Applications/lemon/lemon: -35.78% (1.4194 => 0.9115, std.dev.: 0.0234)
  MultiSource/Benchmarks/MallocBench/gs/gs: -33.31% (0.1189 => 0.0793, std.dev.: 0.0054)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.13% (2.1022 => 1.4267, std.dev.: 0.0032)
  MultiSource/Applications/viterbi/viterbi: -27.38% (3.4923 => 2.5361, std.dev.: 0.0392)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.64% (6.9552 => 5.2411, std.dev.: 0.0322)
  SingleSource/Benchmarks/Misc/perlin: -21.38% (4.5989 => 3.6158, std.dev.: 0.0107)
  MultiSource/Applications/minisat/minisat: -20.52% (8.0162 => 6.3714, std.dev.: 0.5199)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -17.36% (0.0956 => 0.0790, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc/mandel: -14.58% (1.1996 => 1.0247, std.dev.: 0.0002)
  MultiSource/Applications/sgefa/sgefa: -13.13% (1.4030 => 1.2188, std.dev.: 0.0096)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.59% (3.5791 => 3.2359, std.dev.: 0.1259)
  SingleSource/Benchmarks/Shootout/strcat: -9.17% (0.1593 => 0.1447, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -6.12% (0.4969 => 0.4665, std.dev.: 0.0061)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.79% (47.2250 => 44.9644, std.dev.: 0.1610)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.70% (3.8119 => 3.6327, std.dev.: 0.0255)
  SingleSource/Benchmarks/Misc/fbench: -4.53% (4.9602 => 4.7354, std.dev.: 0.0041)
  SingleSource/Regression/C/uint64_to_float: -4.43% (1.5184 => 1.4512, std.dev.: 0.0185)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.24% (0.7355 => 0.7043, std.dev.: 0.0016)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.95% (1.7207 => 1.6528, std.dev.: 0.0054)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.79% (0.3479 => 0.3347, std.dev.: 0.0032)
  MultiSource/Benchmarks/Bullet/bullet: -3.66% (7.2995 => 7.0322, std.dev.: 0.0618)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.46% (6.0444 => 5.8354, std.dev.: 0.0207)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.39% (0.4783 => 0.4621, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9619, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.87% (5.2218 => 5.0721, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/bh/bh: -2.74% (2.4879 => 2.4197, std.dev.: 0.0206)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.50% (0.6480 => 0.6318, std.dev.: 0.0037)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.50% (1.0964 => 1.0690, std.dev.: 0.0087)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.27% (8.6172 => 8.4219, std.dev.: 0.0096)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.16% (0.5097 => 0.4987, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc/oourafft: -2.10% (3.7891 => 3.7094, std.dev.: 0.0018)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.93% (34.8438 => 34.1696, std.dev.: 0.0743)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.62% (1.3104 => 1.2892, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (5.8810 => 5.7953, std.dev.: 0.0234)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.38% (3.2461 => 3.2012, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.35% (4.9231 => 4.8566, std.dev.: 0.0186)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.23% (2.1343 => 2.1080, std.dev.: 0.0084)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -1.13% (1.5112 => 1.4941, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.09% (4.5517 => 4.5020, std.dev.: 0.0092)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.57% (0.1378 => 0.1315, std.dev.: 0.0381)

Report Time: 0.69s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130802/359334fe/attachment.html>


More information about the llvm-testresults mailing list