[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jan 8 06:21:56 PST 2014


http://llvm.org/perf/db_default/v4/nts/20029?compare_to=20018&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 20029, Order: 198750, Start Time: 2014-01-08 12:37:12, End Time: 2014-01-08 14:26:42
      To: 20018, Order: 198743, Start Time: 2014-01-08 10:09:30, End Time: 2014-01-08 12:09:06
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 11 (21 on baseline)
Performance Improvements: 27 (22 on baseline)
Unchanged Tests: 1072 (1067 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/fibo: 59.74% (0.1890 => 0.3019, std.dev.: 0.0017)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Perm: 37.26% (0.0314 => 0.0431, std.dev.: 0.0034)
  MultiSource/Applications/SPASS/SPASS: 7.74% (7.9972 => 8.6159, std.dev.: 0.1859)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.10% (5.0429 => 5.4011, std.dev.: 0.0319)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.61% (3.4902 => 3.7210, std.dev.: 0.0024)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 5.30% (1.9906 => 2.0961, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/flops: 3.72% (9.2712 => 9.6159, std.dev.: 0.0325)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.40% (5.2576 => 5.4362, std.dev.: 0.0068)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.96% (1.6613 => 1.6938, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.62% (1.3079 => 1.3291, std.dev.: 0.0077)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.52% (3.8117 => 3.8698, std.dev.: 0.0049)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/NP/np: -41.05% (0.0363 => 0.0214, std.dev.: 0.0015)
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: -40.60% (0.1239 => 0.0736, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -35.94% (2.0656 => 1.3233, std.dev.: 0.0263)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -34.28% (0.4947 => 0.3251, std.dev.: 0.0067)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -33.30% (0.1009 => 0.0673, std.dev.: 0.0012)
  MultiSource/Benchmarks/Prolangs-C++/office/office: -30.86% (0.3124 => 0.2160, std.dev.: 0.0059)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -29.06% (0.1256 => 0.0891, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -22.70% (1.9360 => 1.4966, std.dev.: 0.0228)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -21.47% (0.3657 => 0.2872, std.dev.: 0.0028)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -18.16% (54.8822 => 44.9178, std.dev.: 2.6173)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -16.92% (0.0656 => 0.0545, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -11.84% (0.2577 => 0.2272, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -7.92% (1.3714 => 1.2628, std.dev.: 0.0254)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.41% (29.7782 => 27.5722, std.dev.: 0.8236)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.74% (1.3366 => 1.2599, std.dev.: 0.0272)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.64% (1.3033 => 1.2558, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.55% (1.2747 => 1.2294, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -3.39% (1.4153 => 1.3673, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.16% (1.2641 => 1.2242, std.dev.: 0.0118)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -1.85% (0.5776 => 0.5669, std.dev.: 0.0029)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -18.67% (0.1200 => 0.0976, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.51% (5.2234 => 4.9356, std.dev.: 0.0277)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.02% (5.2241 => 5.0140, std.dev.: 0.0106)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -3.31% (2.6280 => 2.5411, std.dev.: 0.0077)
  MultiSource/Applications/lambda-0_1_3/lambda: -2.34% (8.0070 => 7.8195, std.dev.: 0.0593)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -2.25% (5.9222 => 5.7891, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.11% (21.6385 => 21.3987, std.dev.: 0.0884)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/fibo: 58.98% (0.1899 => 0.3019, std.dev.: 0.0017)
  MultiSource/Applications/sqlite3/sqlite3: 42.40% (15.7419 => 22.4170, std.dev.: 0.9488)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 28.01% (0.3859 => 0.4940, std.dev.: 0.0054)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.40% (5.0556 => 5.1771, std.dev.: 0.0303)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.69% (5.9583 => 6.9527, std.dev.: 0.1282)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.19% (82.2592 => 92.2844, std.dev.: 0.4024)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (5.0320 => 5.4011, std.dev.: 0.0319)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.24% (1.9729 => 2.0961, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.23% (3.5027 => 3.7210, std.dev.: 0.0024)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.85% (1.2556 => 1.3291, std.dev.: 0.0077)
  MultiSource/Applications/siod/siod: 5.45% (3.4258 => 3.6124, std.dev.: 0.0134)
  SingleSource/Benchmarks/Misc/flops: 3.76% (9.2673 => 9.6159, std.dev.: 0.0325)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.57% (5.2486 => 5.4362, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc/fp-convert: 3.57% (7.3892 => 7.6529, std.dev.: 0.1015)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.54% (0.5112 => 0.5293, std.dev.: 0.0026)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (4.1840 => 4.3196, std.dev.: 0.0359)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.49% (11.7894 => 12.0826, std.dev.: 0.0233)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.54% (2.5025 => 2.5411, std.dev.: 0.0077)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.43% (1.6699 => 1.6938, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.30% (1.4366 => 1.4553, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/matrix: 1.24% (2.8607 => 2.8963, std.dev.: 0.0084)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -24.71% (0.0688 => 0.0518, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -13.73% (0.1938 => 0.1672, std.dev.: 0.0016)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.29% (0.1088 => 0.0976, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3402 => 0.3163, std.dev.: 0.0056)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.77% (0.2540 => 0.2368, std.dev.: 0.0064)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.70% (1.5034 => 1.4027, std.dev.: 0.0164)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.54% (0.1774 => 0.1658, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.16% (2.0207 => 1.8962, std.dev.: 0.0160)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.96% (0.6882 => 0.6472, std.dev.: 0.0040)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.88% (0.2824 => 0.2658, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.58% (1.1409 => 1.0772, std.dev.: 0.0227)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.51% (0.2758 => 0.2606, std.dev.: 0.0031)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.85% (0.3714 => 0.3534, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.47% (1.3146 => 1.2558, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.79% (1.2724 => 1.2242, std.dev.: 0.0118)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.07% (15.4053 => 14.9327, std.dev.: 0.1832)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.97% (1.2670 => 1.2294, std.dev.: 0.0118)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.43% (2.8850 => 2.3822, std.dev.: 0.1116)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.85% (15.5356 => 12.9181, std.dev.: 0.2927)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.88% (0.1035 => 0.0881, std.dev.: 0.0041)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.57% (50.9650 => 45.0687, std.dev.: 1.2173)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.32% (6.0535 => 5.8523, std.dev.: 0.0143)

Report Time: 0.79s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140108/16a6e179/attachment.html>


More information about the llvm-testresults mailing list