[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 24 02:32:45 PST 2013


http://llvm.org/perf/db_default/v4/nts/18938?compare_to=18926&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18938, Order: 197966, Start Time: 2013-12-24 08:50:32, End Time: 2013-12-24 10:37:13
      To: 18926, Order: 197930, Start Time: 2013-12-24 03:38:26, End Time: 2013-12-24 05:18:45
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 26 (39 on baseline)
Performance Improvements: 7 (24 on baseline)
Unchanged Tests: 1077 (1047 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2003-05-23-TransparentUnion: 75.62% (0.0160 => 0.0281, std.dev.: 0.0013)
  SingleSource/Regression/C/uint64_to_float: 34.83% (0.0402 => 0.0542, std.dev.: 0.0046)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.99% (2.7506 => 2.9978, std.dev.: 0.0308)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.10% (1.9811 => 2.1217, std.dev.: 0.0470)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.39% (4.2799 => 4.5107, std.dev.: 0.0544)
  SingleSource/Benchmarks/McGill/chomp: 5.22% (0.2107 => 0.2217, std.dev.: 0.0016)
  SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3077 => 0.3229, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.25% (1.2670 => 1.2828, std.dev.: 0.0034)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 47.20% (1.4480 => 2.1314, std.dev.: 0.0333)
  MultiSource/Applications/minisat/minisat: 23.70% (6.3778 => 7.8891, std.dev.: 0.1009)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 21.45% (2.8294 => 3.4363, std.dev.: 0.2046)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.40% (28.5487 => 33.5150, std.dev.: 0.3225)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.64% (35.4613 => 41.0069, std.dev.: 0.2685)
  MultiSource/Benchmarks/nbench/nbench: 12.48% (20.0586 => 22.5626, std.dev.: 0.5225)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.36% (14.3362 => 15.8221, std.dev.: 0.1810)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.82% (0.3300 => 0.3591, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.22% (3.5686 => 3.8620, std.dev.: 0.0120)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.45% (5.0264 => 5.4007, std.dev.: 0.0261)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.25% (3.9568 => 4.1646, std.dev.: 0.0616)
  SingleSource/Benchmarks/Misc/flops: 3.82% (9.2699 => 9.6241, std.dev.: 0.0161)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.82% (3.4702 => 3.6027, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.59% (5.7270 => 5.9326, std.dev.: 0.0091)
  SingleSource/Benchmarks/Misc/ffbench: 3.41% (1.3797 => 1.4267, std.dev.: 0.0148)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.03% (60.9005 => 62.7477, std.dev.: 0.4535)
  MultiSource/Benchmarks/Olden/tsp/tsp: 2.85% (1.5382 => 1.5821, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.03% (5.9913 => 6.1127, std.dev.: 0.0024)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -28.20% (4.0250 => 2.8898, std.dev.: 0.0340)
  SingleSource/Benchmarks/Shootout/lists: -6.63% (7.5125 => 7.0142, std.dev.: 0.0721)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.24% (7.2392 => 6.9323, std.dev.: 0.0565)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.77% (4.3256 => 4.2057, std.dev.: 0.0080)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.37% (19.0022 => 18.5525, std.dev.: 0.1029)
  MultiSource/Applications/lambda-0_1_3/lambda: -2.00% (7.9977 => 7.8374, std.dev.: 0.0448)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.13% (3.8534 => 3.8099, std.dev.: 0.0143)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2003-05-23-TransparentUnion: 63.37% (0.0172 => 0.0281, std.dev.: 0.0013)
  MultiSource/Applications/sqlite3/sqlite3: 43.54% (15.7419 => 22.5956, std.dev.: 0.4489)
  SingleSource/Regression/C/uint64_to_float: 34.83% (0.0402 => 0.0542, std.dev.: 0.0046)
  MultiSource/Applications/lemon/lemon: 9.13% (1.2200 => 1.3314, std.dev.: 0.0409)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.73% (2.7572 => 2.9978, std.dev.: 0.0308)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.97% (1.9834 => 2.1217, std.dev.: 0.0470)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.59% (4.2717 => 4.5107, std.dev.: 0.0544)
  SingleSource/Benchmarks/Linpack/linpack-pc: 3.86% (0.3109 => 0.3229, std.dev.: 0.0025)
  MultiSource/Applications/JM/lencod/lencod: 3.05% (17.2968 => 17.8238, std.dev.: 0.2045)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.85% (0.3758 => 0.3865, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.54% (0.8787 => 0.9010, std.dev.: 0.0021)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 44.84% (1.4716 => 2.1314, std.dev.: 0.0333)
  MultiSource/Applications/minisat/minisat: 23.50% (6.3881 => 7.8891, std.dev.: 0.1009)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.92% (28.6638 => 33.5150, std.dev.: 0.3225)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.35% (5.9583 => 6.9323, std.dev.: 0.0565)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.01% (35.9684 => 41.0069, std.dev.: 0.2685)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.04% (3.3810 => 3.6527, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.96% (3.5771 => 3.8620, std.dev.: 0.0120)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.33% (5.0320 => 5.4007, std.dev.: 0.0261)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.94% (0.3358 => 0.3591, std.dev.: 0.0055)
  MultiSource/Applications/SIBsim4/SIBsim4: 5.83% (3.4043 => 3.6027, std.dev.: 0.0127)
  MultiSource/Applications/siod/siod: 5.53% (3.4258 => 3.6153, std.dev.: 0.0171)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.32% (2.6658 => 2.8076, std.dev.: 0.0530)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.08% (4.0012 => 4.1646, std.dev.: 0.0616)
  SingleSource/Benchmarks/Misc/flops: 3.85% (9.2673 => 9.6241, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.59% (5.0601 => 5.2420, std.dev.: 0.0484)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.38% (5.9126 => 6.1127, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.73% (61.0792 => 62.7477, std.dev.: 0.4535)
  MultiSource/Benchmarks/Olden/tsp/tsp: 2.57% (1.5425 => 1.5821, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.36% (6.5291 => 6.6834, std.dev.: 0.0274)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.29% (5.7952 => 5.9277, std.dev.: 0.0323)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.28% (21.5962 => 22.0887, std.dev.: 0.1800)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.02% (1.8409 => 1.8781, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.97% (3.1547 => 3.2168, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.74% (11.7894 => 11.9945, std.dev.: 0.0532)
  MultiSource/Applications/hexxagon/hexxagon: 1.70% (14.9989 => 15.2536, std.dev.: 0.0019)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.50% (2.3882 => 2.4241, std.dev.: 0.0056)
  MultiSource/Applications/viterbi/viterbi: 1.28% (2.6366 => 2.6703, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.06% (5.0332 => 5.0868, std.dev.: 0.0025)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.90% (0.3247 => 0.3023, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.27% (1.3676 => 1.2819, std.dev.: 0.0105)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.26% (0.2540 => 0.2381, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.95% (1.3505 => 1.2702, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.48% (1.3146 => 1.2426, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.10% (1.2824 => 1.2170, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.83% (1.4277 => 1.3588, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.74% (1.4113 => 1.3444, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.39% (1.2914 => 1.2347, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.89% (1.3660 => 1.3129, std.dev.: 0.0118)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.64% (1.1409 => 1.0994, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.58% (1.4125 => 1.3619, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.35% (1.3918 => 1.3452, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.18% (1.3460 => 1.3032, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.87% (1.3024 => 1.2650, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.69% (1.3182 => 1.2828, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.37% (1.3510 => 1.3190, std.dev.: 0.0104)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.13% (0.5879 => 0.5754, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.73% (1.2670 => 1.2451, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.70% (1.3551 => 1.3320, std.dev.: 0.0029)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.87% (6.0535 => 5.8799, std.dev.: 0.0276)
  MultiSource/Applications/sqlite3/sqlite3: -1.81% (4.2978 => 4.2198, std.dev.: 0.0231)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.54% (7.9597 => 7.8374, std.dev.: 0.0448)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.10% (4.1462 => 4.1005, std.dev.: 0.0003)

Report Time: 0.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131224/0d97c0bf/attachment.html>


More information about the llvm-testresults mailing list