[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Dec 11 22:57:06 PST 2013


http://llvm.org/perf/db_default/v4/nts/18301?compare_to=18298&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18301, Order: 197125, Start Time: 2013-12-12 05:19:58, End Time: 2013-12-12 07:01:21
      To: 18298, Order: 197116, Start Time: 2013-12-12 03:12:50, End Time: 2013-12-12 04:57:44
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 32 (34 on baseline)
Performance Improvements: 10 (27 on baseline)
Unchanged Tests: 1068 (1049 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.42% (1.2512 => 1.2815, std.dev.: 0.0052)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.00% (0.8070 => 0.8231, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.19% (1.4589 => 1.4763, std.dev.: 0.0023)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 54.22% (1.6890 => 2.6047, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout/matrix: 16.64% (1.8026 => 2.1025, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc/ReedSolomon: 14.92% (8.5063 => 9.7751, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout/sieve: 13.68% (7.1493 => 8.1276, std.dev.: 0.0019)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.76% (1.0262 => 1.1366, std.dev.: 0.0000)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.54% (3.1952 => 3.5321, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.31% (3.5002 => 3.7211, std.dev.: 0.0020)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.77% (0.4424 => 0.4635, std.dev.: 0.0013)
  SingleSource/Benchmarks/McGill/misr: 4.55% (0.3974 => 0.4155, std.dev.: 0.0001)
  MultiSource/Applications/aha/aha: 4.41% (3.5597 => 3.7167, std.dev.: 0.0312)
  SingleSource/Benchmarks/Misc/fp-convert: 4.00% (7.5245 => 7.8252, std.dev.: 0.0230)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (4.2021 => 4.3462, std.dev.: 0.0245)
  MultiSource/Applications/hexxagon/hexxagon: 3.42% (15.0905 => 15.6070, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.39% (5.2493 => 5.4272, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.08% (5.8225 => 6.0020, std.dev.: 0.0077)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.02% (3.7300 => 3.8428, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.76% (6.8539 => 7.0431, std.dev.: 0.0347)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.74% (2.4787 => 2.5465, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc/oourafft: 2.15% (3.6501 => 3.7285, std.dev.: 0.0011)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 2.00% (2.3770 => 2.4246, std.dev.: 0.0066)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.91% (3.3361 => 3.3997, std.dev.: 0.0048)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.84% (2.4840 => 2.5297, std.dev.: 0.0040)
  MultiSource/Applications/viterbi/viterbi: 1.80% (2.6299 => 2.6773, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.72% (3.7994 => 3.8646, std.dev.: 0.0216)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.3116 => 2.3467, std.dev.: 0.0058)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.46% (3.1499 => 3.1958, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.45% (1.2592 => 1.2775, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout/lists: 1.10% (7.3655 => 7.4468, std.dev.: 0.0260)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.00% (5.8251 => 5.8834, std.dev.: 0.0221)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.01% (2.1299 => 1.9806, std.dev.: 0.0037)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.46% (0.2468 => 0.2358, std.dev.: 0.0021)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -25.54% (0.6062 => 0.4514, std.dev.: 0.0178)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -15.25% (1.7125 => 1.4514, std.dev.: 0.0659)
  MultiSource/Applications/JM/ldecod/ldecod: -15.12% (0.0774 => 0.0657, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout/ary3: -11.87% (4.8707 => 4.2925, std.dev.: 0.1799)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.21% (2.1926 => 2.1003, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.48% (61.5571 => 59.4127, std.dev.: 0.6864)
  SingleSource/Benchmarks/Shootout/heapsort: -3.05% (2.9750 => 2.8842, std.dev.: 0.0343)
  SingleSource/Benchmarks/Shootout-C++/ary3: -2.03% (4.8142 => 4.7164, std.dev.: 0.0352)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.04% (0.6412 => 0.6543, std.dev.: 0.0002)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 56.11% (1.6685 => 2.6047, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout/sieve: 20.49% (6.7454 => 8.1276, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/matrix: 17.07% (1.7960 => 2.1025, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc/ReedSolomon: 14.99% (8.5010 => 9.7751, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.83% (3.1585 => 3.5321, std.dev.: 0.0017)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.08% (1.0232 => 1.1366, std.dev.: 0.0000)
  SingleSource/Benchmarks/Stanford/Puzzle: 9.35% (0.1668 => 0.1824, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout/lists: 6.49% (6.9930 => 7.4468, std.dev.: 0.0260)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.24% (3.5027 => 3.7211, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/fp-convert: 5.90% (7.3892 => 7.8252, std.dev.: 0.0230)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.64% (0.6939 => 0.7261, std.dev.: 0.0014)
  MultiSource/Applications/aha/aha: 4.27% (3.5645 => 3.7167, std.dev.: 0.0312)
  MultiSource/Applications/hexxagon/hexxagon: 4.05% (14.9989 => 15.6070, std.dev.: 0.0034)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.88% (4.1840 => 4.3462, std.dev.: 0.0245)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.57% (5.7952 => 6.0020, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.40% (5.2486 => 5.4272, std.dev.: 0.0076)
  SingleSource/Benchmarks/McGill/misr: 3.13% (0.4029 => 0.4155, std.dev.: 0.0001)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.98% (3.7315 => 3.8428, std.dev.: 0.0005)
  MultiSource/Applications/siod/siod: 2.81% (3.4258 => 3.5221, std.dev.: 0.0183)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.50% (1.2463 => 1.2775, std.dev.: 0.0041)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.41% (0.4526 => 0.4635, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.33% (6.8826 => 7.0431, std.dev.: 0.0347)
  SingleSource/Benchmarks/Misc/oourafft: 2.15% (3.6501 => 3.7285, std.dev.: 0.0011)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.12% (0.6261 => 0.6394, std.dev.: 0.0046)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.76% (2.5025 => 2.5465, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout/fib2: 1.66% (3.5960 => 3.6558, std.dev.: 0.0017)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.62% (2.4894 => 2.5297, std.dev.: 0.0040)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.60% (3.1455 => 3.1958, std.dev.: 0.0005)
  MultiSource/Applications/viterbi/viterbi: 1.54% (2.6366 => 2.6773, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.53% (3.8062 => 3.8646, std.dev.: 0.0216)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.52% (2.3882 => 2.4246, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.32% (5.5032 => 5.5756, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.17% (3.5451 => 3.5866, std.dev.: 0.0045)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: -9.73% (36.6274 => 33.0647, std.dev.: 0.6740)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -8.93% (0.3247 => 0.2957, std.dev.: 0.0006)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.89% (25.9661 => 23.9166, std.dev.: 0.6802)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.17% (0.2540 => 0.2358, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.90% (5.8749 => 5.4697, std.dev.: 0.0365)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.15% (1.3505 => 1.2810, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.07% (1.4277 => 1.3553, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.97% (1.3819 => 1.3132, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.82% (1.3146 => 1.2513, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.70% (1.4113 => 1.3450, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.67% (1.5305 => 1.4591, std.dev.: 0.0137)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.58% (1.2824 => 1.2237, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.46% (1.3127 => 1.2541, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.27% (1.3157 => 1.2595, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.63% (1.3264 => 1.2782, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.50% (1.2583 => 1.2143, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.33% (1.2544 => 1.2126, std.dev.: 0.0111)
  MultiSource/Applications/obsequi/Obsequi: -2.88% (1.1905 => 1.1562, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.74% (1.3702 => 1.3326, std.dev.: 0.0047)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.30% (5.0556 => 4.9393, std.dev.: 0.0378)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.08% (1.2670 => 1.2407, std.dev.: 0.0070)
  MultiSource/Benchmarks/nbench/nbench: -2.06% (1.2647 => 1.2387, std.dev.: 0.0094)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -2.00% (1.3256 => 1.2991, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (1.3068 => 1.2815, std.dev.: 0.0052)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: -5.28% (7.4226 => 7.0308, std.dev.: 0.1346)
  SingleSource/Benchmarks/Shootout/hash: -2.90% (5.1896 => 5.0393, std.dev.: 0.0577)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.81% (6.0535 => 5.8834, std.dev.: 0.0221)

Report Time: 1.58s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131212/1cc6d7d4/attachment.html>


More information about the llvm-testresults mailing list