[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jan 3 06:57:00 PST 2014


http://llvm.org/perf/db_default/v4/nts/19612?compare_to=19603&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19612, Order: 198407, Start Time: 2014-01-03 13:15:39, End Time: 2014-01-03 15:01:40
      To: 19603, Order: 198404, Start Time: 2014-01-03 11:09:15, End Time: 2014-01-03 12:52:42
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 24 (37 on baseline)
Performance Improvements: 1 (21 on baseline)
Unchanged Tests: 1085 (1052 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/7zip/7zip-benchmark: 9.89% (44.7041 => 49.1232, std.dev.: 1.4142)
  MultiSource/Benchmarks/mafft/pairlocalalign: 9.63% (10.1374 => 11.1132, std.dev.: 0.0335)
  MultiSource/Benchmarks/Bullet/bullet: 8.96% (33.2399 => 36.2187, std.dev.: 0.3233)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.22% (27.6854 => 29.4066, std.dev.: 0.5626)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.44% (1.2309 => 1.2733, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.55% (1.2879 => 1.3078, std.dev.: 0.0061)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 35.83% (2.9633 => 4.0251, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout/matrix: 16.80% (1.8068 => 2.1104, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/flops: 15.77% (8.0063 => 9.2685, std.dev.: 0.2323)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 10.61% (9.5109 => 10.5196, std.dev.: 0.1048)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.90% (6.2768 => 6.8980, std.dev.: 0.0707)
  MultiSource/Applications/SPASS/SPASS: 8.50% (8.1879 => 8.8840, std.dev.: 0.0673)
  MultiSource/Applications/spiff/spiff: 6.43% (2.8143 => 2.9954, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.39% (2.2587 => 2.3804, std.dev.: 0.0299)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 5.31% (0.4723 => 0.4974, std.dev.: 0.0024)
  MultiSource/Applications/aha/aha: 5.04% (3.5607 => 3.7402, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.95% (5.9021 => 6.1940, std.dev.: 0.0483)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.46% (4.0140 => 4.1931, std.dev.: 0.0469)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.57% (1.8191 => 1.8840, std.dev.: 0.0084)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.79% (23.3983 => 23.8175, std.dev.: 0.0152)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.38% (5.8105 => 5.8908, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.30% (5.3089 => 5.3779, std.dev.: 0.0120)
  SingleSource/Benchmarks/Shootout/fib2: 1.26% (3.6080 => 3.6534, std.dev.: 0.0037)
  MultiSource/Applications/viterbi/viterbi: 1.25% (2.6319 => 2.6648, std.dev.: 0.0073)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -27.25% (0.1989 => 0.1447, std.dev.: 0.0202)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 41.22% (15.7419 => 22.2309, std.dev.: 0.6689)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.25% (25.9661 => 29.4066, std.dev.: 0.5626)
  MultiSource/Applications/lemon/lemon: 11.39% (1.2200 => 1.3589, std.dev.: 0.0150)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 9.36% (44.9186 => 49.1232, std.dev.: 1.4142)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.00% (0.1145 => 0.1248, std.dev.: 0.0025)
  MultiSource/Benchmarks/mafft/pairlocalalign: 7.79% (10.3096 => 11.1132, std.dev.: 0.0335)
  SingleSource/Benchmarks/Misc-C++/bigfib: 4.38% (0.6412 => 0.6693, std.dev.: 0.0007)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.32% (1.5198 => 1.5703, std.dev.: 0.0106)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 40.70% (2.8607 => 4.0251, std.dev.: 0.0017)
  MultiSource/Benchmarks/FreeBench/neural/neural: 32.63% (0.4220 => 0.5597, std.dev.: 0.0109)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.84% (5.9583 => 7.0215, std.dev.: 0.1042)
  SingleSource/Benchmarks/Shootout/matrix: 17.51% (1.7960 => 2.1104, std.dev.: 0.0025)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.43% (82.2592 => 92.4803, std.dev.: 0.3366)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.22% (3.3810 => 3.7605, std.dev.: 0.1255)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.50% (1.1019 => 1.1956, std.dev.: 0.0025)
  SingleSource/Benchmarks/McGill/chomp: 6.77% (1.0099 => 1.0783, std.dev.: 0.0257)
  MultiSource/Applications/spiff/spiff: 6.48% (2.8130 => 2.9954, std.dev.: 0.0009)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 4.97% (10.0217 => 10.5196, std.dev.: 0.1048)
  MultiSource/Applications/aha/aha: 4.93% (3.5645 => 3.7402, std.dev.: 0.0064)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.80% (4.0012 => 4.1931, std.dev.: 0.0469)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.75% (5.9133 => 6.1940, std.dev.: 0.0483)
  MultiSource/Applications/siod/siod: 4.52% (3.4258 => 3.5807, std.dev.: 0.0225)
  MultiSource/Applications/sgefa/sgefa: 4.41% (0.8745 => 0.9131, std.dev.: 0.0011)
  MultiSource/Applications/SPASS/SPASS: 4.07% (8.5363 => 8.8840, std.dev.: 0.0673)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.45% (0.4526 => 0.4637, std.dev.: 0.0002)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.34% (1.8409 => 1.8840, std.dev.: 0.0084)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.25% (1.5986 => 1.6345, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.10% (5.9126 => 6.0366, std.dev.: 0.0356)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (5.8933 => 6.0085, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.92% (2.5025 => 2.5505, std.dev.: 0.0032)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.80% (23.3972 => 23.8175, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.72% (3.1547 => 3.2090, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.68% (5.2486 => 5.3367, std.dev.: 0.0235)
  SingleSource/Benchmarks/Shootout/fib2: 1.60% (3.5960 => 3.6534, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.54% (11.7894 => 11.9709, std.dev.: 0.0514)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.25% (3.1455 => 3.1849, std.dev.: 0.0062)
  MultiSource/Applications/viterbi/viterbi: 1.07% (2.6366 => 2.6648, std.dev.: 0.0073)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.27% (0.2824 => 0.2647, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.51% (1.3127 => 1.2404, std.dev.: 0.0206)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.85% (1.3819 => 1.3149, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.48% (1.2724 => 1.2154, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.37% (1.3676 => 1.3078, std.dev.: 0.0061)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.27% (1.1409 => 1.0922, std.dev.: 0.0178)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.17% (1.2785 => 1.2252, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.87% (1.5305 => 1.4713, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.71% (1.3660 => 1.3153, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.70% (1.2824 => 1.2349, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.14% (1.2914 => 1.2508, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.89% (1.3460 => 1.3071, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.49% (1.3918 => 1.3572, std.dev.: 0.0090)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -26.66% (0.1973 => 0.1447, std.dev.: 0.0202)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.27% (15.5356 => 12.8530, std.dev.: 0.2478)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -16.52% (0.1035 => 0.0864, std.dev.: 0.0043)
  MultiSource/Benchmarks/nbench/nbench: -7.59% (23.4696 => 21.6885, std.dev.: 0.5813)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.69% (6.0535 => 5.8908, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -2.11% (5.1947 => 5.0852, std.dev.: 0.0055)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.93% (99.3511 => 97.4308, std.dev.: 0.6793)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.56% (2.8568 => 2.8123, std.dev.: 0.0097)

Report Time: 0.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140103/4dd4607f/attachment.html>


More information about the llvm-testresults mailing list