[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Dec 5 18:56:31 PST 2013


http://llvm.org/perf/db_default/v4/nts/18037?compare_to=18032&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18037, Order: 196553, Start Time: 2013-12-06 01:13:16, End Time: 2013-12-06 03:00:36
      To: 18032, Order: 196542, Start Time: 2013-12-05 23:01:44, End Time: 2013-12-06 00:47:49
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 42 (42 on baseline)
Performance Improvements: 5 (6 on baseline)
Unchanged Tests: 1063 (1062 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/stmtexpr: 90.50% (0.0179 => 0.0341, std.dev.: 0.0000)
  SingleSource/UnitTests/2002-10-12-StructureArgs: 80.36% (0.0168 => 0.0303, std.dev.: 0.0016)
  SingleSource/UnitTests/member-function-pointers: 77.83% (0.0212 => 0.0377, std.dev.: 0.0012)
  SingleSource/UnitTests/2002-05-02-ManyArguments: 73.68% (0.0171 => 0.0297, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 66.98% (0.1402 => 0.2341, std.dev.: 0.0088)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 54.67% (0.0375 => 0.0580, std.dev.: 0.0038)
  SingleSource/UnitTests/SignlessTypes/rem: 52.79% (0.1201 => 0.1835, std.dev.: 0.0075)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 50.93% (0.0754 => 0.1138, std.dev.: 0.0043)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 43.00% (0.1200 => 0.1716, std.dev.: 0.0180)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.71% (0.1649 => 0.2040, std.dev.: 0.0124)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 20.20% (1.3947 => 1.6764, std.dev.: 0.0666)
  SingleSource/UnitTests/Vector/constpool: 19.98% (9.1642 => 10.9954, std.dev.: 0.0517)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.67% (4.9403 => 5.8627, std.dev.: 0.1769)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.46% (0.0921 => 0.1091, std.dev.: 0.0005)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.23% (7.3210 => 8.5826, std.dev.: 0.3249)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.70% (0.2616 => 0.3053, std.dev.: 0.0092)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 13.16% (0.1953 => 0.2210, std.dev.: 0.0036)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 11.11% (44.0575 => 48.9517, std.dev.: 0.6589)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.04% (14.7543 => 16.2357, std.dev.: 0.3243)
  MultiSource/Benchmarks/Bullet/bullet: 9.58% (32.9625 => 36.1200, std.dev.: 0.6265)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.49% (2.7457 => 2.9787, std.dev.: 0.0379)
  SingleSource/Benchmarks/Shootout-C++/objinst: 6.11% (0.2161 => 0.2293, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.55% (1.4566 => 1.5375, std.dev.: 0.0283)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.68% (24.3221 => 25.4596, std.dev.: 0.3698)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.79% (1.2770 => 1.3254, std.dev.: 0.0155)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.58% (4.2655 => 4.4180, std.dev.: 0.0362)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.51% (0.8179 => 0.8384, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.25% (1.3503 => 1.3672, std.dev.: 0.0056)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.91% (1.4832 => 1.8972, std.dev.: 0.0251)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21.68% (2.3923 => 2.9109, std.dev.: 0.0123)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.81% (35.8916 => 40.4876, std.dev.: 0.4909)
  SingleSource/Benchmarks/Shootout/sieve: 9.96% (7.3978 => 8.1348, std.dev.: 0.0045)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 7.56% (9.5233 => 10.2436, std.dev.: 0.1379)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.99% (60.8489 => 63.8866, std.dev.: 0.5703)
  SingleSource/Benchmarks/Shootout/lists: 4.87% (7.1416 => 7.4893, std.dev.: 0.0110)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.08% (4.0060 => 4.1294, std.dev.: 0.0467)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.94% (21.5336 => 22.1659, std.dev.: 0.0506)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (39.3794 => 40.4545, std.dev.: 0.2772)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.97% (1.5966 => 1.6281, std.dev.: 0.0107)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.70% (5.8065 => 5.9050, std.dev.: 0.0270)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.67% (33.1685 => 33.7239, std.dev.: 0.2048)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.05% (50.2028 => 50.7290, std.dev.: 0.0930)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/hello: -5.29% (0.1928 => 0.1826, std.dev.: 0.0031)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/lists1: -12.15% (0.6667 => 0.5857, std.dev.: 0.0133)
  MultiSource/Benchmarks/nbench/nbench: -10.55% (22.6192 => 20.2334, std.dev.: 0.9125)
  MultiSource/Benchmarks/Olden/health/health: -8.05% (0.3491 => 0.3210, std.dev.: 0.0049)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.68% (0.3182 => 0.3065, std.dev.: 0.0045)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/stmtexpr: 97.11% (0.0173 => 0.0341, std.dev.: 0.0000)
  SingleSource/UnitTests/member-function-pointers: 77.00% (0.0213 => 0.0377, std.dev.: 0.0012)
  SingleSource/UnitTests/2002-10-12-StructureArgs: 67.40% (0.0181 => 0.0303, std.dev.: 0.0016)
  SingleSource/UnitTests/2002-05-02-ManyArguments: 62.30% (0.0183 => 0.0297, std.dev.: 0.0022)
  SingleSource/UnitTests/SignlessTypes/rem: 54.59% (0.1187 => 0.1835, std.dev.: 0.0075)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 53.71% (0.1523 => 0.2341, std.dev.: 0.0088)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 52.75% (0.0745 => 0.1138, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 39.76% (0.0415 => 0.0580, std.dev.: 0.0038)
  SingleSource/UnitTests/Vector/constpool: 19.28% (9.2178 => 10.9954, std.dev.: 0.0517)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.82% (0.0926 => 0.1091, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.36% (5.0823 => 5.8627, std.dev.: 0.1769)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 14.75% (0.1926 => 0.2210, std.dev.: 0.0036)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.25% (7.5124 => 8.5826, std.dev.: 0.3249)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.51% (1.5034 => 1.6764, std.dev.: 0.0666)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.70% (0.2758 => 0.3053, std.dev.: 0.0092)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 8.98% (44.9186 => 48.9517, std.dev.: 0.6589)
  SingleSource/Benchmarks/Shootout-C++/objinst: 8.31% (0.2117 => 0.2293, std.dev.: 0.0030)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.03% (2.7572 => 2.9787, std.dev.: 0.0379)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.10% (1.4629 => 1.5375, std.dev.: 0.0283)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.05% (1.9834 => 2.0836, std.dev.: 0.0216)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.42% (4.2717 => 4.4180, std.dev.: 0.0362)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.18% (1.2845 => 1.3254, std.dev.: 0.0155)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.23% (1.4795 => 1.8972, std.dev.: 0.0251)
  SingleSource/Benchmarks/Shootout/heapsort: 21.30% (2.9492 => 3.5774, std.dev.: 0.1502)
  SingleSource/Benchmarks/Shootout/sieve: 20.60% (6.7454 => 8.1348, std.dev.: 0.0045)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.65% (28.6638 => 33.7239, std.dev.: 0.2048)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.89% (2.5559 => 2.9109, std.dev.: 0.0123)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.56% (35.9684 => 40.4876, std.dev.: 0.4909)
  SingleSource/Benchmarks/Shootout/lists: 7.10% (6.9930 => 7.4893, std.dev.: 0.0110)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (61.0792 => 63.8866, std.dev.: 0.5703)
  SingleSource/Benchmarks/Misc/flops: 3.84% (9.2673 => 9.6231, std.dev.: 0.0327)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.75% (2.3043 => 2.3906, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.59% (5.7952 => 6.0035, std.dev.: 0.0734)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.54% (5.9126 => 6.1220, std.dev.: 0.0541)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.20% (4.0012 => 4.1294, std.dev.: 0.0467)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.64% (21.5962 => 22.1659, std.dev.: 0.0506)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.41% (15.6810 => 16.0585, std.dev.: 0.1017)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 1.89% (0.6388 => 0.6509, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.85% (1.5986 => 1.6281, std.dev.: 0.0107)
  MultiSource/Applications/viterbi/viterbi: 1.67% (2.6366 => 2.6805, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout/fib2: 1.51% (3.5960 => 3.6503, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc/flops-8: 1.03% (2.5116 => 2.5375, std.dev.: 0.0028)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -9.21% (0.3247 => 0.2948, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.98% (1.3505 => 1.2832, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.24% (1.4277 => 1.3672, std.dev.: 0.0056)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -13.79% (23.4696 => 20.2334, std.dev.: 0.9125)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.45% (6.0535 => 5.9050, std.dev.: 0.0270)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.37% (2.5200 => 2.4602, std.dev.: 0.0124)

Report Time: 2.22s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131205/dbb602ae/attachment.html>


More information about the llvm-testresults mailing list