[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 16 07:52:47 PST 2013


http://llvm.org/perf/db_default/v4/nts/18484?compare_to=18480&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18484, Order: 197382, Start Time: 2013-12-16 14:08:19, End Time: 2013-12-16 15:57:07
      To: 18480, Order: 197380, Start Time: 2013-12-16 12:03:15, End Time: 2013-12-16 13:45:46
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 31 (37 on baseline)
Performance Improvements: 12 (12 on baseline)
Unchanged Tests: 1067 (1061 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-07-10-SignConversions: 81.55% (0.0168 => 0.0305, std.dev.: 0.0007)
  SingleSource/UnitTests/2003-08-05-CastFPToUint: 70.39% (0.0206 => 0.0351, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/flops-2: 68.42% (0.0304 => 0.0512, std.dev.: 0.0043)
  SingleSource/UnitTests/2003-05-07-VarArgs: 67.70% (0.0257 => 0.0431, std.dev.: 0.0041)
  SingleSource/UnitTests/2003-07-06-IntOverflow: 57.50% (0.0200 => 0.0315, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout/nestedloop: 44.74% (0.0304 => 0.0440, std.dev.: 0.0043)
  MultiSource/Applications/spiff/spiff: 25.22% (0.9045 => 1.1326, std.dev.: 0.0457)
  SingleSource/Benchmarks/Misc/whetstone: 15.07% (0.0896 => 0.1031, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/flops: 13.49% (0.1112 => 0.1262, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.36% (1.3314 => 1.4960, std.dev.: 0.0461)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.44% (1.2780 => 1.3347, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.73% (0.3803 => 0.3945, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.80% (1.2767 => 1.2997, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.16% (1.3056 => 1.3208, std.dev.: 0.0045)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 43.24% (2.9366 => 4.2064, std.dev.: 0.2140)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 29.62% (1.4654 => 1.8994, std.dev.: 0.1323)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 23.18% (1.4813 => 1.8246, std.dev.: 0.0247)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 15.98% (0.1702 => 0.1974, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.56% (6.7171 => 7.4261, std.dev.: 0.0759)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 10.01% (36.0858 => 39.6974, std.dev.: 1.3086)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 7.39% (60.9675 => 65.4718, std.dev.: 0.8513)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.36% (2.3008 => 2.4702, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.46% (5.9014 => 6.2235, std.dev.: 0.0196)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.31% (40.1044 => 42.2353, std.dev.: 0.6345)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.90% (4.5716 => 4.7954, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.69% (4.1006 => 4.2929, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.17% (6.5604 => 6.8341, std.dev.: 0.0871)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (3.5451 => 3.6369, std.dev.: 0.0319)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.12% (5.8904 => 6.0152, std.dev.: 0.0091)
  SingleSource/Benchmarks/Misc/oourafft: 1.86% (3.6326 => 3.7002, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.66% (6.5704 => 6.6795, std.dev.: 0.0089)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: -11.99% (7.6748 => 6.7547, std.dev.: 0.1418)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.82% (3.7130 => 3.4968, std.dev.: 0.0251)
  SingleSource/Benchmarks/Misc/fp-convert: -5.50% (7.8852 => 7.4515, std.dev.: 0.1483)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -5.21% (1.4986 => 1.4205, std.dev.: 0.0066)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.10% (1.0773 => 1.0224, std.dev.: 0.0135)
  SingleSource/Benchmarks/Shootout/lists: -5.05% (7.5058 => 7.1267, std.dev.: 0.1391)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.46% (4.4003 => 4.2040, std.dev.: 0.0644)
  SingleSource/Benchmarks/Stanford/FloatMM: -4.02% (0.7210 => 0.6920, std.dev.: 0.0042)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.67% (3.8318 => 3.7295, std.dev.: 0.0039)
  MultiSource/Applications/sgefa/sgefa: -1.38% (0.8964 => 0.8840, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.15% (3.5834 => 3.5421, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.03% (4.9922 => 4.9409, std.dev.: 0.0038)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-08-05-CastFPToUint: 68.75% (0.0208 => 0.0351, std.dev.: 0.0017)
  SingleSource/UnitTests/2003-05-07-VarArgs: 66.41% (0.0259 => 0.0431, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/flops-2: 58.51% (0.0323 => 0.0512, std.dev.: 0.0043)
  SingleSource/UnitTests/2003-07-10-SignConversions: 52.50% (0.0200 => 0.0305, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout/nestedloop: 43.32% (0.0307 => 0.0440, std.dev.: 0.0043)
  MultiSource/Applications/sqlite3/sqlite3: 43.25% (15.7419 => 22.5504, std.dev.: 0.8701)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.54% (0.3859 => 0.4883, std.dev.: 0.0046)
  MultiSource/Applications/spiff/spiff: 25.59% (0.9018 => 1.1326, std.dev.: 0.0457)
  SingleSource/Benchmarks/Misc/whetstone: 15.45% (0.0893 => 0.1031, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/flops: 13.29% (0.1114 => 0.1262, std.dev.: 0.0051)
  MultiSource/Applications/lemon/lemon: 10.56% (1.2200 => 1.3488, std.dev.: 0.0479)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.40% (1.3551 => 1.4960, std.dev.: 0.0461)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.98% (0.3758 => 0.3945, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.98% (0.3366 => 0.3500, std.dev.: 0.0050)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 42.63% (2.9492 => 4.2064, std.dev.: 0.2140)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 29.07% (1.4716 => 1.8994, std.dev.: 0.1323)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 23.33% (1.4795 => 1.8246, std.dev.: 0.0247)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.22% (5.9583 => 6.9248, std.dev.: 0.1385)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 15.85% (0.1704 => 0.1974, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 15.65% (6.4210 => 7.4261, std.dev.: 0.0759)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 10.37% (35.9684 => 39.6974, std.dev.: 1.3086)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.15% (3.3810 => 3.6567, std.dev.: 0.0700)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.20% (2.3043 => 2.4702, std.dev.: 0.0230)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 7.19% (61.0792 => 65.4718, std.dev.: 0.8513)
  MultiSource/Applications/SIBsim4/SIBsim4: 6.83% (3.4043 => 3.6369, std.dev.: 0.0319)
  MultiSource/Applications/siod/siod: 5.42% (3.4258 => 3.6116, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.25% (5.9133 => 6.2235, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.51% (4.5883 => 4.7954, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.15% (40.5530 => 42.2353, std.dev.: 0.6345)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.54% (4.1462 => 4.2929, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.99% (11.7894 => 12.1423, std.dev.: 0.1112)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 2.65% (1.3838 => 1.4205, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.30% (6.5291 => 6.6795, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.07% (5.8933 => 6.0152, std.dev.: 0.0091)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.96% (2.5025 => 2.5515, std.dev.: 0.0186)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (2.4894 => 2.5339, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/oourafft: 1.37% (3.6501 => 3.7002, std.dev.: 0.0142)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.03% (0.2824 => 0.2682, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.90% (1.3660 => 1.2991, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.42% (1.3819 => 1.3208, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.18% (1.3505 => 1.2940, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.00% (1.2914 => 1.2398, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.92% (1.2824 => 1.2321, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.14% (1.2724 => 1.2325, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.89% (1.3024 => 1.2647, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.41% (1.3676 => 1.3347, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.01% (1.3264 => 1.2997, std.dev.: 0.0015)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/sim/sim: -5.04% (4.0134 => 3.8110, std.dev.: 0.0226)
  MultiSource/Benchmarks/nbench/nbench: -4.71% (23.4696 => 22.3642, std.dev.: 0.2236)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131216/dcc6b990/attachment.html>


More information about the llvm-testresults mailing list