[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jan 2 15:22:00 PST 2014


http://llvm.org/perf/db_default/v4/nts/19557?compare_to=19544&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19557, Order: 198349, Start Time: 2014-01-02 21:37:18, End Time: 2014-01-02 23:26:37
      To: 19544, Order: 198331, Start Time: 2014-01-02 19:18:12, End Time: 2014-01-02 21:09:29
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 17 (37 on baseline)
Performance Improvements: 16 (14 on baseline)
Unchanged Tests: 1077 (1059 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.77% (0.5300 => 0.6083, std.dev.: 0.0247)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.19% (0.1534 => 0.1721, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.83% (1.2203 => 1.2670, std.dev.: 0.0139)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/JM/ldecod/ldecod: 33.09% (0.0677 => 0.0901, std.dev.: 0.0063)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 24.54% (1.5406 => 1.9187, std.dev.: 0.1065)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.99% (2.4751 => 2.8957, std.dev.: 0.0485)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 14.15% (4.1116 => 4.6935, std.dev.: 0.1492)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.93% (2.1062 => 2.3786, std.dev.: 0.0777)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.38% (82.2412 => 92.4212, std.dev.: 0.2107)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 10.42% (37.7168 => 41.6464, std.dev.: 0.0794)
  SingleSource/Benchmarks/Shootout-C++/fibo: 8.29% (4.9883 => 5.4019, std.dev.: 0.0311)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.18% (1.2559 => 1.3461, std.dev.: 0.0009)
  SingleSource/Benchmarks/Stanford/FloatMM: 6.22% (0.6866 => 0.7293, std.dev.: 0.0045)
  SingleSource/Benchmarks/Misc/richards_benchmark: 3.85% (1.3506 => 1.4026, std.dev.: 0.0129)
  MultiSource/Benchmarks/Bullet/bullet: 3.63% (7.2254 => 7.4875, std.dev.: 0.0503)
  MultiSource/Benchmarks/sim/sim: 3.16% (3.8027 => 3.9230, std.dev.: 0.0402)
  SingleSource/Benchmarks/Shootout/random: 2.61% (2.4162 => 2.4793, std.dev.: 0.0005)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/sumarray: -38.55% (0.0332 => 0.0204, std.dev.: 0.0010)
  SingleSource/UnitTests/Vector/simple: -37.18% (0.0347 => 0.0218, std.dev.: 0.0018)
  MultiSource/Benchmarks/McCat/15-trie/trie: -19.07% (0.0818 => 0.0662, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -17.47% (0.2524 => 0.2083, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: -15.52% (0.1173 => 0.0991, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/bh/bh: -10.68% (0.3718 => 0.3321, std.dev.: 0.0106)
  SingleSource/UnitTests/Vector/constpool: -9.18% (10.2709 => 9.3284, std.dev.: 0.2926)
  MultiSource/Applications/SPASS/SPASS: -8.69% (18.6048 => 16.9879, std.dev.: 0.6010)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.84% (0.3127 => 0.2913, std.dev.: 0.0025)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.68% (15.7580 => 12.9720, std.dev.: 0.2074)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.10% (0.1023 => 0.0889, std.dev.: 0.0040)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.51% (33.7290 => 30.8585, std.dev.: 0.3307)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.04% (3.6993 => 3.5870, std.dev.: 0.0412)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.86% (3.2519 => 3.1588, std.dev.: 0.0276)
  MultiSource/Applications/aha/aha: -2.22% (3.6380 => 3.5574, std.dev.: 0.0094)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.32% (1.4666 => 1.4473, std.dev.: 0.0065)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 46.84% (15.7419 => 23.1149, std.dev.: 0.8238)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 31.36% (0.3859 => 0.5069, std.dev.: 0.0443)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.48% (0.5134 => 0.6083, std.dev.: 0.0247)
  MultiSource/Applications/lemon/lemon: 14.91% (1.2200 => 1.4019, std.dev.: 0.0421)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.78% (25.9661 => 29.5443, std.dev.: 0.6143)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.00% (0.1523 => 0.1721, std.dev.: 0.0050)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.86% (2.7572 => 3.0843, std.dev.: 0.1207)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.13% (0.1145 => 0.1261, std.dev.: 0.0000)
  MultiSource/Applications/oggenc/oggenc: 7.95% (5.4968 => 5.9340, std.dev.: 0.1010)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.89% (1.9834 => 2.1399, std.dev.: 0.0421)
  SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.1899 => 0.2006, std.dev.: 0.0020)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/JM/ldecod/ldecod: 37.35% (0.0656 => 0.0901, std.dev.: 0.0063)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 30.38% (1.4716 => 1.9187, std.dev.: 0.1065)
  SingleSource/Benchmarks/Shootout/heapsort: 29.66% (2.9492 => 3.8238, std.dev.: 0.3131)
  MultiSource/Applications/lemon/lemon: 26.65% (0.8632 => 1.0932, std.dev.: 0.0729)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.53% (5.9583 => 6.9435, std.dev.: 0.2083)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.79% (35.9684 => 41.6464, std.dev.: 0.0794)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 15.70% (4.0567 => 4.6935, std.dev.: 0.1492)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.29% (2.5559 => 2.8957, std.dev.: 0.0485)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.16% (2.1020 => 2.3786, std.dev.: 0.0777)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.35% (82.2592 => 92.4212, std.dev.: 0.2107)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.43% (3.3810 => 3.6660, std.dev.: 0.0485)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 7.66% (28.6638 => 30.8585, std.dev.: 0.3307)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.35% (5.0320 => 5.4019, std.dev.: 0.0311)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.21% (1.2556 => 1.3461, std.dev.: 0.0009)
  SingleSource/Benchmarks/McGill/chomp: 7.19% (1.0099 => 1.0825, std.dev.: 0.0198)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.10% (0.6939 => 0.7293, std.dev.: 0.0045)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.56% (3.4043 => 3.5597, std.dev.: 0.0074)
  MultiSource/Applications/sgefa/sgefa: 4.00% (0.8745 => 0.9095, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc/flops: 3.84% (9.2673 => 9.6233, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.80% (4.1462 => 4.3038, std.dev.: 0.0280)
  SingleSource/Benchmarks/Misc/richards_benchmark: 3.61% (1.3537 => 1.4026, std.dev.: 0.0129)
  SingleSource/Benchmarks/Misc/ffbench: 2.43% (1.4103 => 1.4446, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.42% (3.8062 => 3.8984, std.dev.: 0.0081)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.25% (1.2463 => 1.2744, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/oourafft: 2.09% (3.6501 => 3.7265, std.dev.: 0.0204)
  SingleSource/Benchmarks/Shootout/lists: 1.98% (6.9930 => 7.1313, std.dev.: 0.0523)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -24.56% (0.0688 => 0.0519, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.50% (0.3247 => 0.3036, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.72% (1.4277 => 1.3460, std.dev.: 0.0189)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.63% (0.2824 => 0.2665, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.95% (1.4113 => 1.3415, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.02% (1.3819 => 1.3264, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.48% (1.4125 => 1.3634, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.67% (1.3157 => 1.2806, std.dev.: 0.0072)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.50% (15.5356 => 12.9720, std.dev.: 0.2074)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.11% (0.1035 => 0.0889, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.32% (5.9456 => 5.5696, std.dev.: 0.0095)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.19% (6.0535 => 5.8602, std.dev.: 0.0456)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.71% (3.6605 => 3.5979, std.dev.: 0.0195)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.33% (1.6699 => 1.6477, std.dev.: 0.0004)

Report Time: 0.79s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140102/1cc3cbd9/attachment.html>


More information about the llvm-testresults mailing list