[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Dec 6 21:02:42 PST 2013


http://llvm.org/perf/db_default/v4/nts/18088?compare_to=18083&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18088, Order: 196635, Start Time: 2013-12-07 03:19:24, End Time: 2013-12-07 05:06:52
      To: 18083, Order: 196627, Start Time: 2013-12-07 01:06:40, End Time: 2013-12-07 02:53:26
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 34 (41 on baseline)
Performance Improvements: 25 (18 on baseline)
Unchanged Tests: 1051 (1051 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 75.48% (0.0930 => 0.1632, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 64.25% (0.0730 => 0.1199, std.dev.: 0.0086)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 59.27% (0.0739 => 0.1177, std.dev.: 0.0094)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 57.48% (0.0301 => 0.0474, std.dev.: 0.0017)
  MultiSource/Benchmarks/llubenchmark/llu: 57.06% (0.0538 => 0.0845, std.dev.: 0.0081)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 29.18% (1.0967 => 1.4167, std.dev.: 0.0440)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 26.54% (0.6948 => 0.8792, std.dev.: 0.0556)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 26.44% (5.0022 => 6.3246, std.dev.: 0.4135)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 25.57% (0.2663 => 0.3344, std.dev.: 0.0201)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 22.90% (0.7377 => 0.9066, std.dev.: 0.0613)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 18.83% (1.4315 => 1.7011, std.dev.: 0.0668)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.80% (0.3893 => 0.4547, std.dev.: 0.0163)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.50% (1.4546 => 1.6800, std.dev.: 0.0854)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.09% (7.4427 => 8.4911, std.dev.: 0.3752)
  MultiSource/Benchmarks/nbench/nbench: 6.60% (1.2460 => 1.3282, std.dev.: 0.0289)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.57% (1.2872 => 1.3718, std.dev.: 0.0182)
  MultiSource/Applications/sqlite3/sqlite3: 5.85% (15.7302 => 16.6507, std.dev.: 0.0547)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 5.64% (0.1969 => 0.2080, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.18% (1.3413 => 1.4108, std.dev.: 0.0136)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.16% (2.8570 => 3.0043, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.39% (1.3516 => 1.4109, std.dev.: 0.0188)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.23% (0.8969 => 0.9079, std.dev.: 0.0039)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 58.33% (0.7763 => 1.2291, std.dev.: 0.0473)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.02% (1.4840 => 1.8702, std.dev.: 0.0193)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 17.40% (0.1764 => 0.2071, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.67% (0.2801 => 0.3156, std.dev.: 0.0123)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 11.18% (2.1113 => 2.3473, std.dev.: 0.0197)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 6.63% (2.3320 => 2.4865, std.dev.: 0.0375)
  SingleSource/Benchmarks/Misc/salsa20: 6.38% (7.6811 => 8.1708, std.dev.: 0.0571)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.53% (40.8721 => 42.7216, std.dev.: 0.2639)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.36% (61.3325 => 63.3958, std.dev.: 0.7710)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.99% (2.9210 => 3.0084, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.35% (6.5314 => 6.6852, std.dev.: 0.0129)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.19% (0.6393 => 0.6533, std.dev.: 0.0010)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: -46.44% (0.0379 => 0.0203, std.dev.: 0.0033)
  SingleSource/Regression/C++/EH/simple_throw: -42.23% (0.0296 => 0.0171, std.dev.: 0.0039)
  SingleSource/Regression/C++/EH/exception_spec_test: -41.63% (0.0603 => 0.0352, std.dev.: 0.0069)
  SingleSource/Regression/C++/EH/ConditionalExpr: -36.24% (0.0367 => 0.0234, std.dev.: 0.0017)
  SingleSource/Regression/C++/EH/recursive-throw: -34.52% (0.0394 => 0.0258, std.dev.: 0.0037)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -32.95% (0.3335 => 0.2236, std.dev.: 0.0136)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -29.20% (0.8218 => 0.5818, std.dev.: 0.0136)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -20.08% (0.4522 => 0.3614, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -11.02% (1.4888 => 1.3248, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -11.01% (1.5184 => 1.3512, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -8.24% (1.4551 => 1.3352, std.dev.: 0.0326)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.98% (1.4347 => 1.3345, std.dev.: 0.0189)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.38% (1.3508 => 1.2917, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.68% (1.2675 => 1.2208, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.57% (1.3190 => 1.2851, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.53% (1.4970 => 1.4592, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.06% (1.2728 => 1.2466, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: -44.64% (0.0233 => 0.0129, std.dev.: 0.0040)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -14.51% (4.6935 => 4.0124, std.dev.: 0.0567)
  MultiSource/Benchmarks/nbench/nbench: -8.83% (23.2077 => 21.1573, std.dev.: 0.6849)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.51% (0.4661 => 0.4404, std.dev.: 0.0008)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.69% (1.6948 => 1.6492, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.76% (3.2207 => 3.1640, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.71% (6.0032 => 5.9004, std.dev.: 0.0127)
  MultiSource/Benchmarks/Olden/em3d/em3d: -1.26% (4.5694 => 4.5117, std.dev.: 0.0150)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 76.24% (0.0926 => 0.1632, std.dev.: 0.0062)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 66.90% (0.0284 => 0.0474, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 64.02% (0.0731 => 0.1199, std.dev.: 0.0086)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 62.12% (0.0726 => 0.1177, std.dev.: 0.0094)
  MultiSource/Benchmarks/llubenchmark/llu: 60.04% (0.0528 => 0.0845, std.dev.: 0.0081)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 30.81% (1.0830 => 1.4167, std.dev.: 0.0440)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 25.69% (0.6995 => 0.8792, std.dev.: 0.0556)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 24.44% (5.0823 => 6.3246, std.dev.: 0.4135)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.27% (0.2691 => 0.3344, std.dev.: 0.0201)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 23.11% (0.5663 => 0.6972, std.dev.: 0.0492)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 22.93% (0.7375 => 0.9066, std.dev.: 0.0613)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.83% (0.3859 => 0.4547, std.dev.: 0.0163)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.27% (1.4449 => 1.6800, std.dev.: 0.0854)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.15% (1.5034 => 1.7011, std.dev.: 0.0668)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.03% (7.5124 => 8.4911, std.dev.: 0.3752)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.15% (0.2251 => 0.2502, std.dev.: 0.0027)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.96% (2.7572 => 3.0043, std.dev.: 0.0150)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 5.90% (0.2137 => 0.2263, std.dev.: 0.0028)
  MultiSource/Applications/sqlite3/sqlite3: 5.77% (15.7419 => 16.6507, std.dev.: 0.0547)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.21% (4.2717 => 4.4943, std.dev.: 0.0653)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.82% (1.3460 => 1.4109, std.dev.: 0.0188)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.32% (0.8787 => 0.9079, std.dev.: 0.0039)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 60.25% (0.7670 => 1.2291, std.dev.: 0.0473)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.41% (1.4795 => 1.8702, std.dev.: 0.0193)
  MultiSource/Applications/minisat/minisat: 21.26% (6.3881 => 7.7461, std.dev.: 0.5256)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 17.14% (0.1768 => 0.2071, std.dev.: 0.0029)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 11.67% (2.1020 => 2.3473, std.dev.: 0.0197)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 9.32% (2.8940 => 3.1638, std.dev.: 0.0795)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.18% (0.6261 => 0.6836, std.dev.: 0.0148)
  SingleSource/Benchmarks/Misc/salsa20: 7.59% (7.5947 => 8.1708, std.dev.: 0.0571)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 6.47% (2.3355 => 2.4865, std.dev.: 0.0375)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.35% (40.5530 => 42.7216, std.dev.: 0.2639)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.93% (3.9755 => 4.1318, std.dev.: 0.0303)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.79% (61.0792 => 63.3958, std.dev.: 0.7710)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.69% (2.3043 => 2.3894, std.dev.: 0.0053)
  MultiSource/Applications/sgefa/sgefa: 2.96% (0.8745 => 0.9004, std.dev.: 0.0062)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.91% (2.9233 => 3.0084, std.dev.: 0.0084)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.60% (1.5797 => 1.6207, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.39% (6.5291 => 6.6852, std.dev.: 0.0129)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.27% (0.6388 => 0.6533, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.02% (5.8933 => 6.0123, std.dev.: 0.0051)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.03% (1.3676 => 1.2851, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.70% (1.2824 => 1.2093, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.17% (1.3819 => 1.3105, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.00% (1.3146 => 1.2489, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.78% (1.3127 => 1.2500, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.66% (1.5305 => 1.4592, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.23% (1.3157 => 1.2601, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.67% (1.2544 => 1.2084, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.92% (1.3918 => 1.3512, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.81% (1.2583 => 1.2229, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.01% (1.3182 => 1.2917, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.94% (1.3510 => 1.3248, std.dev.: 0.0049)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -9.85% (23.4696 => 21.1573, std.dev.: 0.6849)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -8.21% (6.8826 => 6.3174, std.dev.: 0.2069)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -7.28% (0.5219 => 0.4839, std.dev.: 0.0112)
  MultiSource/Benchmarks/sim/sim: -5.02% (4.0134 => 3.8120, std.dev.: 0.0452)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.70% (0.4526 => 0.4404, std.dev.: 0.0008)
  MultiSource/Benchmarks/Olden/em3d/em3d: -2.18% (4.6123 => 4.5117, std.dev.: 0.0150)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131206/cc487773/attachment.html>


More information about the llvm-testresults mailing list