[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Dec 29 21:45:49 PST 2013


http://llvm.org/perf/db_default/v4/nts/19312?compare_to=19300&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19312, Order: 198197, Start Time: 2013-12-30 04:05:13, End Time: 2013-12-30 05:50:24
      To: 19300, Order: 198187, Start Time: 2013-12-30 01:48:08, End Time: 2013-12-30 03:38:52
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 15 (22 on baseline)
Performance Improvements: 43 (17 on baseline)
Unchanged Tests: 1052 (1071 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 36.79% (1.6681 => 2.2818, std.dev.: 0.1554)
  SingleSource/Benchmarks/Stanford/Puzzle: 13.82% (0.1628 => 0.1853, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout/matrix: 13.21% (1.8640 => 2.1103, std.dev.: 0.0047)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.82% (1.2577 => 1.3435, std.dev.: 0.0020)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.34% (1.0255 => 1.0905, std.dev.: 0.0216)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.74% (0.3737 => 0.3914, std.dev.: 0.0035)
  MultiSource/Applications/aha/aha: 4.49% (3.5703 => 3.7307, std.dev.: 0.0223)
  SingleSource/Benchmarks/Misc/ffbench: 3.43% (1.3851 => 1.4326, std.dev.: 0.0088)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 3.37% (0.4746 => 0.4906, std.dev.: 0.0033)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.86% (5.4104 => 5.5649, std.dev.: 0.0566)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 1.64% (0.6403 => 0.6508, std.dev.: 0.0013)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (2.4892 => 2.5275, std.dev.: 0.0038)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.50% (8.8085 => 8.9406, std.dev.: 0.0019)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.44% (3.8058 => 3.8606, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.24% (6.0397 => 6.1148, std.dev.: 0.0043)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: -41.87% (0.1156 => 0.0672, std.dev.: 0.0025)
  SingleSource/Benchmarks/Stanford/IntMM: -36.07% (0.0682 => 0.0436, std.dev.: 0.0008)
  SingleSource/Benchmarks/Stanford/Perm: -27.07% (0.0458 => 0.0334, std.dev.: 0.0008)
  SingleSource/Benchmarks/Stanford/Quicksort: -20.56% (0.0501 => 0.0398, std.dev.: 0.0005)
  SingleSource/Benchmarks/SmallPT/smallpt: -20.51% (0.1780 => 0.1415, std.dev.: 0.0051)
  MultiSource/Benchmarks/McCat/15-trie/trie: -15.55% (0.0804 => 0.0679, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -15.05% (0.2325 => 0.1975, std.dev.: 0.0005)
  SingleSource/Benchmarks/Stanford/Oscar: -13.43% (0.0789 => 0.0683, std.dev.: 0.0010)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -13.04% (0.5976 => 0.5197, std.dev.: 0.0096)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -11.89% (0.1093 => 0.0963, std.dev.: 0.0033)
  SingleSource/Benchmarks/McGill/chomp: -11.66% (0.2478 => 0.2189, std.dev.: 0.0033)
  MultiSource/Applications/SPASS/SPASS: -11.39% (18.7224 => 16.5905, std.dev.: 0.2162)
  MultiSource/Applications/sgefa/sgefa: -9.11% (0.4270 => 0.3881, std.dev.: 0.0049)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.96% (0.2474 => 0.2277, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/wc: -6.71% (0.2400 => 0.2239, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -6.60% (0.2287 => 0.2136, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/lists: -6.27% (0.2744 => 0.2572, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/matrix: -5.56% (0.2516 => 0.2376, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -5.45% (0.2093 => 0.1979, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.02% (1.3109 => 1.2451, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.94% (1.3918 => 1.3231, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/moments: -4.73% (0.4017 => 0.3827, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.42% (1.3417 => 1.2824, std.dev.: 0.0065)
  MultiSource/Benchmarks/nbench/nbench: -4.31% (1.3003 => 1.2442, std.dev.: 0.0195)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.00% (1.2864 => 1.2349, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.55% (1.2828 => 1.2373, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.41% (1.2808 => 1.2371, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.08% (1.3806 => 1.3381, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.88% (1.2594 => 1.2231, std.dev.: 0.0131)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.81% (2.6129 => 2.5394, std.dev.: 0.0233)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -28.89% (0.6012 => 0.4275, std.dev.: 0.0116)
  MultiSource/Benchmarks/McCat/18-imp/imp: -19.16% (0.1268 => 0.1025, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -11.97% (0.1637 => 0.1441, std.dev.: 0.0005)
  MultiSource/Applications/SPASS/SPASS: -8.93% (8.9053 => 8.1104, std.dev.: 0.1386)
  SingleSource/Benchmarks/Shootout-C++/moments: -8.53% (0.1219 => 0.1115, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/fibo: -6.84% (5.4056 => 5.0357, std.dev.: 0.1146)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.70% (1.5606 => 1.5029, std.dev.: 0.0043)
  MultiSource/Applications/viterbi/viterbi: -1.78% (2.6777 => 2.6300, std.dev.: 0.0138)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.73% (3.6043 => 3.5421, std.dev.: 0.0178)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.71% (1.3079 => 1.2855, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/flops-8: -1.53% (2.5754 => 2.5359, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.50% (4.1213 => 4.0596, std.dev.: 0.0230)
  SingleSource/Benchmarks/Misc/fbench: -1.02% (4.9738 => 4.9229, std.dev.: 0.0060)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 40.41% (15.7419 => 22.1037, std.dev.: 0.6007)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 30.55% (0.3859 => 0.5038, std.dev.: 0.0453)
  MultiSource/Applications/oggenc/oggenc: 3.38% (5.4968 => 5.6826, std.dev.: 0.0544)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 36.76% (1.6685 => 2.2818, std.dev.: 0.1554)
  SingleSource/Benchmarks/Shootout/matrix: 17.50% (1.7960 => 2.1103, std.dev.: 0.0047)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.33% (5.9583 => 6.9909, std.dev.: 0.1238)
  SingleSource/Benchmarks/Stanford/Puzzle: 11.09% (0.1668 => 0.1853, std.dev.: 0.0001)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.00% (1.2556 => 1.3435, std.dev.: 0.0020)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.58% (1.0232 => 1.0905, std.dev.: 0.0216)
  MultiSource/Applications/lua/lua: 5.95% (29.1357 => 30.8697, std.dev.: 0.6002)
  MultiSource/Applications/siod/siod: 4.80% (3.4258 => 3.5901, std.dev.: 0.0154)
  MultiSource/Applications/aha/aha: 4.66% (3.5645 => 3.7307, std.dev.: 0.0223)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (3.4043 => 3.5421, std.dev.: 0.0178)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.47% (2.3043 => 2.3842, std.dev.: 0.0287)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.42% (5.9126 => 6.1148, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.15% (1.2463 => 1.2855, std.dev.: 0.0078)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.61% (1.5797 => 1.6209, std.dev.: 0.0079)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.88% (2.4894 => 2.5363, std.dev.: 0.0169)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 1.88% (0.6388 => 0.6508, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.81% (6.5291 => 6.6472, std.dev.: 0.0396)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.72% (11.7894 => 11.9923, std.dev.: 0.0374)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.51% (8.8073 => 8.9406, std.dev.: 0.0019)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -8.19% (0.3247 => 0.2981, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.36% (1.3676 => 1.2806, std.dev.: 0.0232)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.49% (0.2824 => 0.2669, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.19% (1.4113 => 1.3381, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.04% (1.3505 => 1.2824, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.97% (1.3146 => 1.2492, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.40% (1.3024 => 1.2451, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.38% (1.2914 => 1.2349, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.87% (1.2724 => 1.2231, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.72% (1.3264 => 1.2771, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.24% (1.2785 => 1.2371, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.78% (1.3182 => 1.2815, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.36% (1.3551 => 1.3231, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.94% (1.2952 => 1.2701, std.dev.: 0.0041)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/SPASS/SPASS: -4.99% (8.5363 => 8.1104, std.dev.: 0.1386)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.60% (7.9597 => 7.8324, std.dev.: 0.0018)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.48% (2.8568 => 2.8145, std.dev.: 0.0128)

Report Time: 1.07s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131229/7f7c093e/attachment.html>


More information about the llvm-testresults mailing list