[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 30 23:32:00 PST 2013


http://llvm.org/perf/db_default/v4/nts/19382?compare_to=19377&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19382, Order: 198258, Start Time: 2013-12-31 05:54:25, End Time: 2013-12-31 07:36:37
      To: 19377, Order: 198254, Start Time: 2013-12-31 03:48:56, End Time: 2013-12-31 05:31:21
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 30 (36 on baseline)
Performance Improvements: 5 (31 on baseline)
Unchanged Tests: 1075 (1043 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.59% (0.3011 => 0.3119, std.dev.: 0.0010)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 44.09% (0.1388 => 0.2000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc/pi: 37.86% (1.8874 => 2.6020, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/matrix: 32.10% (3.0470 => 4.0252, std.dev.: 0.0002)
  MultiSource/Benchmarks/Olden/em3d/em3d: 21.07% (4.5025 => 5.4510, std.dev.: 0.0626)
  SingleSource/Benchmarks/Shootout/sieve: 11.57% (6.7536 => 7.5352, std.dev.: 0.2821)
  SingleSource/Benchmarks/Shootout/matrix: 10.41% (1.9092 => 2.1079, std.dev.: 0.0021)
  MultiSource/Applications/JM/lencod/lencod: 7.00% (7.9873 => 8.5467, std.dev.: 0.1363)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 6.06% (3.6767 => 3.8995, std.dev.: 0.0737)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 5.97% (1.9719 => 2.0896, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc/fp-convert: 5.74% (7.4380 => 7.8652, std.dev.: 0.0080)
  MultiSource/Applications/aha/aha: 5.64% (3.5736 => 3.7751, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.31% (4.4683 => 4.7057, std.dev.: 0.0489)
  SingleSource/Benchmarks/McGill/misr: 5.07% (0.3947 => 0.4147, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout/lists: 4.87% (7.1600 => 7.5086, std.dev.: 0.0054)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.53% (1.8151 => 1.8974, std.dev.: 0.0042)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.81% (4.2352 => 4.3965, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.51% (5.9006 => 6.1076, std.dev.: 0.0296)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.22% (1.6406 => 1.6935, std.dev.: 0.0005)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 3.12% (9.3249 => 9.6158, std.dev.: 0.0768)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.10% (5.7624 => 5.9408, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.09% (6.5421 => 6.7443, std.dev.: 0.0715)
  SingleSource/Benchmarks/Shootout-C++/hash: 2.99% (0.7224 => 0.7440, std.dev.: 0.0008)
  SingleSource/Benchmarks/Stanford/FloatMM: 2.96% (0.7001 => 0.7208, std.dev.: 0.0036)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.64% (3.7359 => 3.8345, std.dev.: 0.0006)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.51% (2.4982 => 2.5358, std.dev.: 0.0017)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.50% (3.8045 => 3.8617, std.dev.: 0.0055)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.42% (23.4533 => 23.7872, std.dev.: 0.0222)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.23% (2.4682 => 2.4985, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.20% (3.5340 => 3.5765, std.dev.: 0.0050)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.44% (0.4872 => 0.4753, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.18% (5.5581 => 5.4369, std.dev.: 0.0246)
  SingleSource/Benchmarks/Misc-C++/bigfib: -1.60% (0.6696 => 0.6589, std.dev.: 0.0036)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.17% (1.0987 => 1.0858, std.dev.: 0.0042)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (52.5312 => 51.5600, std.dev.: 0.3172)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 38.61% (15.7419 => 21.8191, std.dev.: 1.2159)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 28.56% (0.3859 => 0.4961, std.dev.: 0.0019)
  MultiSource/Applications/lemon/lemon: 9.33% (1.2200 => 1.3338, std.dev.: 0.0328)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.76% (0.6412 => 0.6589, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.19% (0.8787 => 0.8892, std.dev.: 0.0008)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 55.95% (1.6685 => 2.6020, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/matrix: 40.71% (2.8607 => 4.0252, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.52% (5.9583 => 7.2405, std.dev.: 0.0051)
  MultiSource/Benchmarks/Olden/em3d/em3d: 18.18% (4.6123 => 5.4510, std.dev.: 0.0626)
  SingleSource/Benchmarks/Shootout/matrix: 17.37% (1.7960 => 2.1079, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout/sieve: 11.71% (6.7454 => 7.5352, std.dev.: 0.2821)
  SingleSource/Benchmarks/Stanford/Puzzle: 9.65% (0.1668 => 0.1829, std.dev.: 0.0011)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.40% (1.1019 => 1.1945, std.dev.: 0.0078)
  MultiSource/Applications/JM/lencod/lencod: 7.57% (7.9450 => 8.5467, std.dev.: 0.1363)
  SingleSource/Benchmarks/Shootout/lists: 7.37% (6.9930 => 7.5086, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc/fp-convert: 6.44% (7.3892 => 7.8652, std.dev.: 0.0080)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 5.92% (1.9729 => 2.0896, std.dev.: 0.0028)
  MultiSource/Applications/aha/aha: 5.91% (3.5645 => 3.7751, std.dev.: 0.0040)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.08% (4.1840 => 4.3965, std.dev.: 0.0072)
  MultiSource/Applications/siod/siod: 5.07% (3.4258 => 3.5995, std.dev.: 0.0135)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.88% (0.6939 => 0.7208, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.35% (5.9126 => 6.1108, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.29% (5.9133 => 6.1076, std.dev.: 0.0296)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.11% (0.5112 => 0.5271, std.dev.: 0.0053)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.07% (1.8409 => 1.8974, std.dev.: 0.0042)
  SingleSource/Benchmarks/McGill/misr: 2.93% (0.4029 => 0.4147, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.76% (3.7315 => 3.8345, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.24% (5.5032 => 5.6262, std.dev.: 0.0192)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.10% (3.1547 => 3.2209, std.dev.: 0.0157)
  SingleSource/Benchmarks/Misc/oourafft: 1.99% (3.6501 => 3.7229, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.88% (11.7894 => 12.0107, std.dev.: 0.0546)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.86% (2.4894 => 2.5358, std.dev.: 0.0017)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.67% (23.3972 => 23.7872, std.dev.: 0.0222)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (1.6699 => 1.6935, std.dev.: 0.0005)
  MultiSource/Applications/viterbi/viterbi: 1.35% (2.6366 => 2.6723, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.26% (2.8940 => 2.9305, std.dev.: 0.0086)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -27.03% (0.0688 => 0.0502, std.dev.: 0.0010)
  MultiSource/Benchmarks/Bullet/bullet: -9.49% (36.6274 => 33.1499, std.dev.: 0.1233)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -8.32% (0.3402 => 0.3119, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.46% (5.8749 => 5.4369, std.dev.: 0.0246)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.16% (1.5034 => 1.3957, std.dev.: 0.0165)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.74% (0.6882 => 0.6418, std.dev.: 0.0032)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.71% (0.1774 => 0.1655, std.dev.: 0.0012)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2540 => 0.2380, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.18% (1.3676 => 1.2831, std.dev.: 0.0256)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.10% (0.1673 => 0.1571, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.44% (0.2810 => 0.2657, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.99% (1.3819 => 1.3130, std.dev.: 0.0226)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.83% (1.1409 => 1.0858, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.51% (15.4053 => 14.7108, std.dev.: 0.0916)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.27% (1.4449 => 1.3832, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.95% (1.2824 => 1.2317, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.70% (1.3157 => 1.2670, std.dev.: 0.0071)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.04% (7.5124 => 7.2837, std.dev.: 0.0650)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.80% (0.3714 => 0.3610, std.dev.: 0.0010)
  MultiSource/Benchmarks/nbench/nbench: -2.31% (1.2647 => 1.2355, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.11% (1.3608 => 1.3321, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.07% (1.4074 => 1.3782, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.02% (4.7807 => 4.6841, std.dev.: 0.0218)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.75% (10.3096 => 10.1294, std.dev.: 0.0093)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: -6.58% (7.4226 => 6.9343, std.dev.: 0.0315)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -4.93% (2.9945 => 2.8468, std.dev.: 0.0417)
  MultiSource/Applications/sqlite3/sqlite3: -4.23% (4.2978 => 4.1160, std.dev.: 0.0554)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -4.08% (6.0535 => 5.8066, std.dev.: 0.0295)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -4.05% (10.0217 => 9.6158, std.dev.: 0.0768)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.95% (2.5559 => 2.4806, std.dev.: 0.0143)
  SingleSource/Benchmarks/Shootout/hash: -2.90% (5.1896 => 5.0393, std.dev.: 0.0559)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131231/8628bb16/attachment.html>


More information about the llvm-testresults mailing list