[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Dec 28 10:35:12 PST 2013


http://llvm.org/perf/db_default/v4/nts/19185?compare_to=19177&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19185, Order: 198115, Start Time: 2013-12-28 16:56:46, End Time: 2013-12-28 18:39:47
      To: 19177, Order: 198114, Start Time: 2013-12-28 13:57:52, End Time: 2013-12-28 15:38:19
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 11 (35 on baseline)
Performance Improvements: 3 (36 on baseline)
Unchanged Tests: 1096 (1039 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 5.30% (0.2113 => 0.2225, std.dev.: 0.0004)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.08% (0.7005 => 0.7221, std.dev.: 0.0047)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.24% (0.6741 => 0.6892, std.dev.: 0.0040)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: 16.37% (1.8148 => 2.1118, std.dev.: 0.0025)
  MultiSource/Applications/JM/lencod/lencod: 10.96% (7.6964 => 8.5397, std.dev.: 0.1144)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.93% (2.2211 => 2.3305, std.dev.: 0.0322)
  SingleSource/Benchmarks/Misc/ffbench: 3.70% (1.3790 => 1.4300, std.dev.: 0.0108)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.06% (2.4529 => 2.5280, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (2.4712 => 2.5328, std.dev.: 0.0035)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.67% (6.7386 => 6.8514, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.56% (7.0557 => 7.1657, std.dev.: 0.0269)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -10.12% (0.1235 => 0.1110, std.dev.: 0.0017)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -6.52% (87.8043 => 82.0784, std.dev.: 0.1551)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.41% (3.1358 => 2.9347, std.dev.: 0.0051)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 40.71% (15.7419 => 22.1509, std.dev.: 2.1897)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.72% (0.3859 => 0.4890, std.dev.: 0.0063)
  MultiSource/Applications/lemon/lemon: 9.57% (1.2200 => 1.3367, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc-C++/bigfib: 4.48% (0.6412 => 0.6699, std.dev.: 0.0017)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.36% (0.6322 => 0.6471, std.dev.: 0.0029)
  MultiSource/Applications/oggenc/oggenc: 2.35% (5.4968 => 5.6260, std.dev.: 0.0388)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.99% (1.5198 => 1.5501, std.dev.: 0.0086)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.8787 => 0.8955, std.dev.: 0.0016)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.82% (0.6769 => 0.6892, std.dev.: 0.0040)
  MultiSource/Applications/minisat/minisat: 1.70% (0.7533 => 0.7661, std.dev.: 0.0017)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: 17.58% (1.7960 => 2.1118, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 15.78% (5.9583 => 6.8988, std.dev.: 0.3336)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.59% (1.0232 => 1.1316, std.dev.: 0.0021)
  MultiSource/Applications/lua/lua: 10.13% (29.1357 => 32.0872, std.dev.: 0.5058)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.97% (1.3838 => 1.5079, std.dev.: 0.0001)
  MultiSource/Applications/JM/lencod/lencod: 7.49% (7.9450 => 8.5397, std.dev.: 0.1144)
  SingleSource/Benchmarks/Misc/fp-convert: 5.95% (7.3892 => 7.8285, std.dev.: 0.0224)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.57% (0.6261 => 0.6610, std.dev.: 0.0002)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.36% (1.2278 => 1.2936, std.dev.: 0.0042)
  MultiSource/Applications/siod/siod: 5.05% (3.4258 => 3.5989, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.91% (3.5771 => 3.7526, std.dev.: 0.0520)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.57% (4.1840 => 4.3752, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.68% (5.0601 => 5.2461, std.dev.: 0.0058)
  MultiSource/Applications/hexxagon/hexxagon: 3.53% (14.9989 => 15.5288, std.dev.: 0.0398)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.58% (11.7894 => 12.0931, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.55% (6.5291 => 6.6956, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.39% (1.5797 => 1.6175, std.dev.: 0.0124)
  SingleSource/Benchmarks/Misc/oourafft: 2.05% (3.6501 => 3.7251, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.02% (5.9126 => 6.0321, std.dev.: 0.0402)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.89% (2.5025 => 2.5497, std.dev.: 0.0011)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.74% (2.4894 => 2.5328, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.41% (2.8940 => 2.9347, std.dev.: 0.0051)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.38% (3.1455 => 3.1890, std.dev.: 0.0045)
  MultiSource/Applications/viterbi/viterbi: 1.36% (2.6366 => 2.6725, std.dev.: 0.0066)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.12% (6.7756 => 6.8514, std.dev.: 0.0014)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.89% (0.0688 => 0.0503, std.dev.: 0.0066)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -12.56% (0.1051 => 0.0919, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.85% (0.3247 => 0.2992, std.dev.: 0.0030)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.33% (0.2824 => 0.2617, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.76% (5.8749 => 5.4780, std.dev.: 0.0807)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.49% (0.9437 => 0.8825, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.23% (1.3676 => 1.2824, std.dev.: 0.0232)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.98% (0.2540 => 0.2388, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.60% (1.2824 => 1.2106, std.dev.: 0.0202)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.80% (1.3819 => 1.3156, std.dev.: 0.0246)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.69% (1.4113 => 1.3451, std.dev.: 0.0253)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.63% (1.3146 => 1.2537, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.11% (1.3660 => 1.3099, std.dev.: 0.0169)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.87% (1.1409 => 1.0968, std.dev.: 0.0124)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -3.79% (0.2691 => 0.2589, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.41% (1.3918 => 1.3444, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.36% (1.2544 => 1.2122, std.dev.: 0.0111)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.82% (1.1767 => 1.1435, std.dev.: 0.0022)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.77% (7.5124 => 7.3041, std.dev.: 0.0759)
  MultiSource/Applications/obsequi/Obsequi: -2.72% (1.1905 => 1.1581, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.71% (1.3182 => 1.2825, std.dev.: 0.0080)
  MultiSource/Applications/d/make_dparser: -2.54% (3.6428 => 3.5504, std.dev.: 0.0093)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.44% (0.6995 => 0.6824, std.dev.: 0.0034)
  MultiSource/Benchmarks/nbench/nbench: -2.40% (1.2647 => 1.2343, std.dev.: 0.0069)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -2.39% (1.3256 => 1.2939, std.dev.: 0.0084)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.14% (0.5322 => 0.5208, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.09% (0.7375 => 0.7221, std.dev.: 0.0047)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.40% (1.1608 => 1.1446, std.dev.: 0.0032)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -10.21% (1.4335 => 1.2871, std.dev.: 0.0209)
  MultiSource/Benchmarks/nbench/nbench: -8.61% (23.4696 => 21.4498, std.dev.: 0.7078)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -8.19% (10.0217 => 9.2010, std.dev.: 0.2271)
  MultiSource/Applications/sqlite3/sqlite3: -4.44% (4.2978 => 4.1070, std.dev.: 0.0420)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -4.19% (6.0535 => 5.7999, std.dev.: 0.0461)
  MultiSource/Applications/lemon/lemon: -3.64% (0.8632 => 0.8318, std.dev.: 0.0082)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.41% (3.6583 => 3.5701, std.dev.: 0.0272)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.09% (4.1462 => 4.1012, std.dev.: 0.0105)

Report Time: 0.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131228/eeb26ae2/attachment.html>


More information about the llvm-testresults mailing list