[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Dec 6 12:08:01 PST 2013


http://llvm.org/perf/db_default/v4/nts/18070?compare_to=18066&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18070, Order: 196585, Start Time: 2013-12-06 18:25:10, End Time: 2013-12-06 20:12:11
      To: 18066, Order: 196582, Start Time: 2013-12-06 16:15:15, End Time: 2013-12-06 17:59:27
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 47 (35 on baseline)
Performance Improvements: 7 (14 on baseline)
Unchanged Tests: 1056 (1061 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 78.40% (0.0324 => 0.0578, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 60.65% (0.0859 => 0.1380, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 48.20% (0.0722 => 0.1070, std.dev.: 0.0092)
  SingleSource/Benchmarks/Misc/flops-7: 47.37% (0.0304 => 0.0448, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 40.41% (0.0740 => 0.1039, std.dev.: 0.0113)
  SingleSource/UnitTests/SignlessTypes/factor: 39.76% (0.0337 => 0.0471, std.dev.: 0.0047)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 24.42% (1.6371 => 2.0369, std.dev.: 0.0483)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.55% (1.4130 => 1.7317, std.dev.: 0.0660)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.86% (4.9359 => 6.0148, std.dev.: 0.1879)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 19.41% (0.0747 => 0.0892, std.dev.: 0.0019)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.85% (0.1215 => 0.1444, std.dev.: 0.0048)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.29% (0.1638 => 0.1872, std.dev.: 0.0068)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.41% (4.6589 => 5.2372, std.dev.: 0.1131)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 11.19% (1.5163 => 1.6859, std.dev.: 0.0457)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 11.01% (44.0472 => 48.8962, std.dev.: 0.7294)
  MultiSource/Benchmarks/Bullet/bullet: 8.62% (32.7817 => 35.6087, std.dev.: 0.5102)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.18% (1.4447 => 1.5629, std.dev.: 0.0409)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.94% (5.9485 => 6.4211, std.dev.: 0.0572)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.74% (14.7988 => 15.9445, std.dev.: 0.2700)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.86% (24.0002 => 25.6465, std.dev.: 0.1975)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.17% (0.3516 => 0.3733, std.dev.: 0.0020)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.93% (0.9286 => 0.9651, std.dev.: 0.0133)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.80% (0.6390 => 0.6633, std.dev.: 0.0081)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.45% (1.0901 => 1.1168, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.08% (1.2806 => 1.3073, std.dev.: 0.0062)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.74% (0.6281 => 0.6390, std.dev.: 0.0031)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 64.11% (0.0248 => 0.0407, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 21.61% (1.4811 => 1.8012, std.dev.: 0.0459)
  MultiSource/Benchmarks/Olden/em3d/em3d: 17.18% (4.5781 => 5.3648, std.dev.: 0.0418)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.71% (28.6807 => 33.1862, std.dev.: 0.9182)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.81% (36.1828 => 40.8178, std.dev.: 0.6591)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 11.60% (9.2958 => 10.3742, std.dev.: 0.3291)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.60% (13.9234 => 15.5380, std.dev.: 0.3642)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 9.69% (1.3750 => 1.5083, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/salsa20: 8.16% (7.5399 => 8.1548, std.dev.: 0.0460)
  MultiSource/Benchmarks/Bullet/bullet: 6.86% (6.9304 => 7.4059, std.dev.: 0.1466)
  MultiSource/Applications/minisat/minisat: 5.35% (6.3358 => 6.6746, std.dev.: 0.1041)
  MultiSource/Applications/spiff/spiff: 4.59% (2.8657 => 2.9971, std.dev.: 0.0154)
  SingleSource/Benchmarks/Misc/flops: 3.92% (9.2714 => 9.6349, std.dev.: 0.0176)
  MultiSource/Applications/aha/aha: 3.68% (3.5570 => 3.6880, std.dev.: 0.0410)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.26% (0.4515 => 0.4662, std.dev.: 0.0001)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.81% (39.6541 => 40.7687, std.dev.: 0.3581)
  SingleSource/UnitTests/Vector/multiplies: 1.94% (0.5835 => 0.5948, std.dev.: 0.0011)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.31% (2.4815 => 2.5141, std.dev.: 0.0119)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.19% (18.5364 => 18.7572, std.dev.: 0.0464)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.14% (16.6182 => 16.8081, std.dev.: 0.0178)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.04% (4.9446 => 4.9962, std.dev.: 0.0008)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -30.45% (0.0578 => 0.0402, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.06% (0.2097 => 0.1970, std.dev.: 0.0042)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (4.5641 => 4.3694, std.dev.: 0.0484)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Treesort: -24.16% (0.0898 => 0.0681, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/pi: -4.15% (1.7007 => 1.6302, std.dev.: 0.0220)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.99% (3.4220 => 3.3540, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.83% (5.4046 => 5.3058, std.dev.: 0.0209)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 67.54% (0.0345 => 0.0578, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 58.26% (0.0872 => 0.1380, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/flops-7: 49.83% (0.0299 => 0.0448, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 47.38% (0.0726 => 0.1070, std.dev.: 0.0092)
  SingleSource/UnitTests/SignlessTypes/factor: 38.53% (0.0340 => 0.0471, std.dev.: 0.0047)
  SingleSource/Benchmarks/Stanford/IntMM: 33.18% (0.0437 => 0.0582, std.dev.: 0.0051)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 22.29% (1.6656 => 2.0369, std.dev.: 0.0483)
  SingleSource/Benchmarks/Stanford/Oscar: 21.64% (0.0684 => 0.0832, std.dev.: 0.0035)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.85% (1.4449 => 1.7317, std.dev.: 0.0660)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.97% (5.0556 => 6.0148, std.dev.: 0.1879)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.84% (0.0770 => 0.0892, std.dev.: 0.0019)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.81% (0.1280 => 0.1444, std.dev.: 0.0048)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 12.44% (1.4994 => 1.6859, std.dev.: 0.0457)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.55% (4.7807 => 5.2372, std.dev.: 0.1131)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.30% (5.8749 => 6.4211, std.dev.: 0.0572)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 8.86% (44.9186 => 48.8962, std.dev.: 0.7294)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.46% (0.0276 => 0.0407, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 21.74% (1.4795 => 1.8012, std.dev.: 0.0459)
  MultiSource/Benchmarks/Olden/em3d/em3d: 16.32% (4.6123 => 5.3648, std.dev.: 0.0418)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.78% (28.6638 => 33.1862, std.dev.: 0.9182)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.48% (35.9684 => 40.8178, std.dev.: 0.6591)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 9.00% (1.3838 => 1.5083, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/salsa20: 7.37% (7.5947 => 8.1548, std.dev.: 0.0460)
  SingleSource/Benchmarks/McGill/chomp: 7.26% (1.0099 => 1.0832, std.dev.: 0.0150)
  MultiSource/Applications/spiff/spiff: 6.54% (2.8130 => 2.9971, std.dev.: 0.0154)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.36% (2.8940 => 3.0780, std.dev.: 0.0637)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.16% (1.1019 => 1.1588, std.dev.: 0.0187)
  MultiSource/Applications/minisat/minisat: 4.48% (6.3881 => 6.6746, std.dev.: 0.1041)
  SingleSource/Benchmarks/Misc/flops: 3.97% (9.2673 => 9.6349, std.dev.: 0.0176)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.86% (2.3043 => 2.3932, std.dev.: 0.0330)
  MultiSource/Applications/aha/aha: 3.46% (3.5645 => 3.6880, std.dev.: 0.0410)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.00% (0.4526 => 0.4662, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.07% (1.5797 => 1.6124, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.21% (4.9365 => 4.9962, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.13% (16.6205 => 16.8081, std.dev.: 0.0178)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.69% (1.3505 => 1.2871, std.dev.: 0.0208)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.97% (1.3660 => 1.3118, std.dev.: 0.0087)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.62% (0.6882 => 0.6633, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.54% (1.4125 => 1.3625, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.52% (1.2824 => 1.2373, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.36% (1.2724 => 1.2297, std.dev.: 0.0160)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.88% (1.3460 => 1.3073, std.dev.: 0.0062)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.11% (1.1409 => 1.1168, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.85% (1.2670 => 1.2436, std.dev.: 0.0076)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -11.50% (0.1035 => 0.0916, std.dev.: 0.0013)
  MultiSource/Benchmarks/nbench/nbench: -10.45% (23.4696 => 21.0171, std.dev.: 0.8451)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.94% (6.0535 => 5.8753, std.dev.: 0.0504)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.43% (1.8409 => 1.8146, std.dev.: 0.0089)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.09% (50.9650 => 50.4118, std.dev.: 0.1891)

Report Time: 0.65s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131206/75da03bd/attachment.html>


More information about the llvm-testresults mailing list