[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jan 2 13:04:50 PST 2014


http://llvm.org/perf/db_default/v4/nts/19544?compare_to=19531&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19544, Order: 198331, Start Time: 2014-01-02 19:18:12, End Time: 2014-01-02 21:09:29
      To: 19531, Order: 198313, Start Time: 2014-01-02 17:02:39, End Time: 2014-01-02 18:50:37
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 26 (39 on baseline)
Performance Improvements: 8 (11 on baseline)
Unchanged Tests: 1076 (1060 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/sumarray: 62.75% (0.0204 => 0.0332, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 58.21% (0.0761 => 0.1204, std.dev.: 0.0115)
  MultiSource/Applications/spiff/spiff: 37.21% (0.9090 => 1.2472, std.dev.: 0.0696)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.96% (0.0986 => 0.1311, std.dev.: 0.0097)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 32.45% (0.2422 => 0.3208, std.dev.: 0.0180)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 29.54% (1.4289 => 1.8510, std.dev.: 0.0647)
  MultiSource/Benchmarks/McCat/09-vor/vor: 20.17% (0.3634 => 0.4367, std.dev.: 0.0280)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.59% (7.4659 => 8.6299, std.dev.: 0.3808)
  MultiSource/Applications/SPASS/SPASS: 11.86% (16.6325 => 18.6048, std.dev.: 0.1684)
  MultiSource/Applications/sqlite3/sqlite3: 6.61% (22.0899 => 23.5502, std.dev.: 0.4268)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.96% (1.2665 => 1.2913, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.89% (1.5047 => 1.5331, std.dev.: 0.0083)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: 24.18% (1.3223 => 1.6420, std.dev.: 0.0620)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.59% (0.3338 => 0.3992, std.dev.: 0.0085)
  MultiSource/Applications/lemon/lemon: 16.21% (0.8457 => 0.9828, std.dev.: 0.0249)
  MultiSource/Applications/SPASS/SPASS: 14.98% (8.1983 => 9.4264, std.dev.: 0.2726)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 14.75% (1.4837 => 1.7026, std.dev.: 0.0813)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.04% (29.5762 => 33.7290, std.dev.: 0.3052)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.02% (2.2698 => 2.4519, std.dev.: 0.0390)
  MultiSource/Applications/sgefa/sgefa: 5.69% (0.8652 => 0.9144, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.61% (4.1880 => 4.2974, std.dev.: 0.0176)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.55% (2.4784 => 2.5416, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.46% (6.9587 => 7.1298, std.dev.: 0.0435)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.35% (4.6845 => 4.7946, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.67% (6.5266 => 6.6355, std.dev.: 0.0338)
  SingleSource/Benchmarks/Misc/oourafft: 1.50% (3.6450 => 3.6998, std.dev.: 0.0132)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/lists1: -5.66% (0.3268 => 0.3083, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.79% (1.3609 => 1.3093, std.dev.: 0.0054)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Queens: -34.18% (0.0395 => 0.0260, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -27.56% (0.1970 => 0.1427, std.dev.: 0.0205)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -7.07% (0.1712 => 0.1591, std.dev.: 0.0043)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.11% (1.3376 => 1.2559, std.dev.: 0.0041)
  MultiSource/Benchmarks/Bullet/bullet: -3.10% (7.4569 => 7.2254, std.dev.: 0.0731)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.00% (3.6517 => 3.5423, std.dev.: 0.0125)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Threads/2010-12-08-tls: 72.08% (0.0154 => 0.0265, std.dev.: 0.0010)
  SingleSource/UnitTests/Vector/sumarray: 64.36% (0.0202 => 0.0332, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 61.18% (0.0747 => 0.1204, std.dev.: 0.0115)
  MultiSource/Applications/sqlite3/sqlite3: 49.60% (15.7419 => 23.5502, std.dev.: 0.4268)
  SingleSource/UnitTests/Threads/tls: 46.58% (0.0234 => 0.0343, std.dev.: 0.0029)
  MultiSource/Applications/spiff/spiff: 38.30% (0.9018 => 1.2472, std.dev.: 0.0696)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 26.30% (0.2540 => 0.3208, std.dev.: 0.0180)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.74% (0.1051 => 0.1311, std.dev.: 0.0097)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.12% (1.5034 => 1.8510, std.dev.: 0.0647)
  MultiSource/Benchmarks/McCat/09-vor/vor: 21.44% (0.3596 => 0.4367, std.dev.: 0.0280)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.88% (7.5124 => 8.6299, std.dev.: 0.3808)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.62% (25.9661 => 29.5020, std.dev.: 0.2887)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.66% (0.1145 => 0.1290, std.dev.: 0.0026)
  MultiSource/Applications/SPASS/SPASS: 11.29% (16.7177 => 18.6048, std.dev.: 0.1684)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.65% (0.2691 => 0.2816, std.dev.: 0.0037)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.08% (4.5769 => 5.6790, std.dev.: 0.2592)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 19.66% (5.9583 => 7.1298, std.dev.: 0.0435)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.88% (0.3358 => 0.3992, std.dev.: 0.0085)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.67% (28.6638 => 33.7290, std.dev.: 0.3052)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.07% (0.1359 => 0.1591, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 15.08% (1.4795 => 1.7026, std.dev.: 0.0813)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 14.54% (1.4335 => 1.6420, std.dev.: 0.0620)
  MultiSource/Applications/lemon/lemon: 13.86% (0.8632 => 0.9828, std.dev.: 0.0249)
  MultiSource/Applications/SPASS/SPASS: 10.43% (8.5363 => 9.4264, std.dev.: 0.2726)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.91% (3.3810 => 3.6483, std.dev.: 0.0722)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.41% (2.3043 => 2.4519, std.dev.: 0.0390)
  MultiSource/Applications/siod/siod: 5.79% (3.4258 => 3.6242, std.dev.: 0.0283)
  MultiSource/Applications/sgefa/sgefa: 4.56% (0.8745 => 0.9144, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.50% (4.5883 => 4.7946, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.05% (40.5530 => 42.1949, std.dev.: 0.5910)
  SingleSource/Benchmarks/McGill/chomp: 4.01% (1.0099 => 1.0504, std.dev.: 0.0058)
  SingleSource/Benchmarks/Misc/flops: 3.91% (9.2673 => 9.6293, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.65% (4.1462 => 4.2974, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.88% (5.9126 => 6.0831, std.dev.: 0.0112)
  MultiSource/Applications/aha/aha: 2.06% (3.5645 => 3.6380, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.94% (11.7894 => 12.0185, std.dev.: 0.0434)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.63% (6.5291 => 6.6355, std.dev.: 0.0338)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.56% (2.5025 => 2.5416, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/oourafft: 1.36% (3.6501 => 3.6998, std.dev.: 0.0132)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -22.67% (0.0688 => 0.0532, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.77% (1.4125 => 1.3592, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -3.21% (1.3819 => 1.3376, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.05% (1.3505 => 1.3093, std.dev.: 0.0054)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -27.67% (0.1973 => 0.1427, std.dev.: 0.0205)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.78% (0.3970 => 0.3820, std.dev.: 0.0054)
  MultiSource/Benchmarks/Bullet/bullet: -2.66% (7.4226 => 7.2254, std.dev.: 0.0731)
  SingleSource/Benchmarks/Shootout/random: -2.54% (2.4791 => 2.4162, std.dev.: 0.0239)
  MultiSource/Benchmarks/Olden/em3d/em3d: -1.68% (4.6123 => 4.5350, std.dev.: 0.0288)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.43% (2.5200 => 2.4839, std.dev.: 0.0129)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.34% (7.9597 => 7.8530, std.dev.: 0.0145)

Report Time: 0.79s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140102/a6c8cf2b/attachment.html>


More information about the llvm-testresults mailing list