[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Nov 28 19:49:26 PST 2013


http://llvm.org/perf/db_default/v4/nts/17706?compare_to=17699&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17706, Order: 195937, Start Time: 2013-11-29 02:05:31, End Time: 2013-11-29 03:53:26
      To: 17699, Order: 195934, Start Time: 2013-11-28 22:21:04, End Time: 2013-11-29 00:00:22
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 54 (39 on baseline)
Performance Improvements: 6 (10 on baseline)
Unchanged Tests: 1050 (1061 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 75.29% (0.0510 => 0.0894, std.dev.: 0.0011)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 70.33% (0.0492 => 0.0838, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 64.36% (0.0738 => 0.1213, std.dev.: 0.0084)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 63.43% (0.0834 => 0.1363, std.dev.: 0.0063)
  SingleSource/Benchmarks/Stanford/Bubblesort: 48.28% (0.0319 => 0.0473, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 47.87% (0.0823 => 0.1217, std.dev.: 0.0128)
  SingleSource/Benchmarks/Stanford/IntMM: 47.70% (0.0348 => 0.0514, std.dev.: 0.0021)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 42.42% (0.1200 => 0.1709, std.dev.: 0.0196)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 40.69% (0.0548 => 0.0771, std.dev.: 0.0086)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 39.52% (0.0830 => 0.1158, std.dev.: 0.0096)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 31.75% (1.4099 => 1.8576, std.dev.: 0.0674)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 30.65% (0.5697 => 0.7443, std.dev.: 0.0373)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 29.04% (4.8494 => 6.2575, std.dev.: 0.2880)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 26.38% (0.6599 => 0.8340, std.dev.: 0.0572)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.56% (1.0800 => 1.3561, std.dev.: 0.1025)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.32% (1.8917 => 2.2571, std.dev.: 0.0728)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.29% (9.7720 => 11.4618, std.dev.: 0.4077)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.14% (1.6881 => 1.9606, std.dev.: 0.0477)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.53% (1.3653 => 1.5773, std.dev.: 0.0453)
  MultiSource/Benchmarks/MallocBench/gs/gs: 14.05% (4.6379 => 5.2894, std.dev.: 0.2513)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.11% (0.8780 => 0.9931, std.dev.: 0.0409)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 12.49% (44.0206 => 49.5199, std.dev.: 1.2598)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.93% (14.7364 => 16.2003, std.dev.: 0.1023)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.49% (23.8311 => 26.0929, std.dev.: 0.2386)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.78% (5.8434 => 6.3566, std.dev.: 0.0356)
  MultiSource/Applications/ClamAV/clamscan: 8.48% (16.7290 => 18.1469, std.dev.: 0.2632)
  MultiSource/Benchmarks/mafft/pairlocalalign: 7.82% (10.0705 => 10.8581, std.dev.: 0.2325)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.70% (2.7492 => 2.9608, std.dev.: 0.0500)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.89% (1.9718 => 2.1076, std.dev.: 0.0112)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 6.02% (0.1678 => 0.1779, std.dev.: 0.0024)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.49% (4.2397 => 4.4725, std.dev.: 0.0284)
  MultiSource/Applications/kimwitu++/kc: 4.96% (18.4407 => 19.3553, std.dev.: 0.2914)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 2.91% (0.3920 => 0.4034, std.dev.: 0.0026)
  MultiSource/Applications/oggenc/oggenc: 2.62% (5.4240 => 5.5663, std.dev.: 0.0405)
  MultiSource/Applications/JM/ldecod/ldecod: 1.76% (7.5815 => 7.7150, std.dev.: 0.0423)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: 78.21% (0.0794 => 0.1415, std.dev.: 0.0040)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 60.50% (0.7668 => 1.2307, std.dev.: 0.0724)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 28.92% (1.4589 => 1.8808, std.dev.: 0.0422)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.90% (1.4803 => 1.8785, std.dev.: 0.0091)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.50% (2.3800 => 2.9869, std.dev.: 0.1291)
  MultiSource/Benchmarks/Olden/bisort/bisort: 24.53% (0.6698 => 0.8341, std.dev.: 0.0530)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21.26% (2.4204 => 2.9349, std.dev.: 0.0264)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.26% (35.6642 => 41.1055, std.dev.: 0.3823)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.41% (2.1025 => 2.3634, std.dev.: 0.0101)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.19% (60.0824 => 63.7997, std.dev.: 0.7079)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.59% (40.3270 => 42.5801, std.dev.: 0.6039)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 4.54% (2.9488 => 3.0828, std.dev.: 0.0464)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.84% (5.2591 => 5.4085, std.dev.: 0.0016)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 2.54% (2.3682 => 2.4283, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.37% (5.0926 => 5.2133, std.dev.: 0.0256)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 1.89% (0.6409 => 0.6530, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.81% (7.7327 => 7.8728, std.dev.: 0.0327)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.22% (5.3698 => 5.4355, std.dev.: 0.0072)
  SingleSource/Benchmarks/Misc/mandel: 1.20% (1.0465 => 1.0591, std.dev.: 0.0041)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.72% (1.8963 => 1.8067, std.dev.: 0.0251)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.19% (4.3971 => 4.2128, std.dev.: 0.0084)
  MultiSource/Applications/hexxagon/hexxagon: -3.73% (15.5986 => 15.0164, std.dev.: 0.2051)
  MultiSource/Applications/siod/siod: -3.22% (3.5660 => 3.4512, std.dev.: 0.0183)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (1.6936 => 1.6395, std.dev.: 0.0090)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.67% (52.1252 => 50.7333, std.dev.: 0.0908)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 74.95% (0.0511 => 0.0894, std.dev.: 0.0011)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 63.99% (0.0511 => 0.0838, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 62.82% (0.0745 => 0.1213, std.dev.: 0.0084)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 58.30% (0.0861 => 0.1363, std.dev.: 0.0063)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 47.16% (0.0827 => 0.1217, std.dev.: 0.0128)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 39.86% (0.0828 => 0.1158, std.dev.: 0.0096)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 31.43% (0.5663 => 0.7443, std.dev.: 0.0373)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 26.42% (0.6597 => 0.8340, std.dev.: 0.0572)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.22% (1.0830 => 1.3561, std.dev.: 0.1025)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.56% (1.5034 => 1.8576, std.dev.: 0.0674)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 23.12% (5.0823 => 6.2575, std.dev.: 0.2880)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.45% (9.8425 => 11.4618, std.dev.: 0.4077)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.96% (1.7054 => 1.9606, std.dev.: 0.0477)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.70% (2.0207 => 2.2571, std.dev.: 0.0728)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 10.24% (44.9186 => 49.5199, std.dev.: 1.2598)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.16% (1.4449 => 1.5773, std.dev.: 0.0453)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.20% (5.8749 => 6.3566, std.dev.: 0.0356)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.38% (2.7572 => 2.9608, std.dev.: 0.0500)
  MultiSource/Applications/ClamAV/clamscan: 6.96% (16.9661 => 18.1469, std.dev.: 0.2632)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.26% (1.9834 => 2.1076, std.dev.: 0.0112)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.16% (15.4053 => 16.2003, std.dev.: 0.1023)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.70% (4.2717 => 4.4725, std.dev.: 0.0284)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: 72.14% (0.0822 => 0.1415, std.dev.: 0.0040)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 60.46% (0.7670 => 1.2307, std.dev.: 0.0724)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 27.81% (1.4716 => 1.8808, std.dev.: 0.0422)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.97% (1.4795 => 1.8785, std.dev.: 0.0091)
  MultiSource/Benchmarks/Olden/bisort/bisort: 23.90% (0.6732 => 0.8341, std.dev.: 0.0530)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.83% (2.5559 => 2.9349, std.dev.: 0.0264)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.28% (35.9684 => 41.1055, std.dev.: 0.3823)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.44% (2.1020 => 2.3634, std.dev.: 0.0101)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.52% (2.8940 => 3.0828, std.dev.: 0.0464)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.00% (40.5530 => 42.5801, std.dev.: 0.6039)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.45% (61.0792 => 63.7997, std.dev.: 0.7079)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.56% (5.2486 => 5.4355, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.51% (5.9456 => 6.0949, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.34% (7.6931 => 7.8728, std.dev.: 0.0327)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.22% (0.6388 => 0.6530, std.dev.: 0.0006)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.68% (2.3882 => 2.4283, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.16% (5.3463 => 5.4085, std.dev.: 0.0016)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -10.59% (0.3247 => 0.2903, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.82% (1.4277 => 1.3446, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.63% (1.3676 => 1.2906, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.85% (1.3146 => 1.2508, std.dev.: 0.0210)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.51% (1.2914 => 1.2332, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.05% (1.3182 => 1.2648, std.dev.: 0.0159)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.31% (1.4790 => 1.4300, std.dev.: 0.0148)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -9.71% (23.4696 => 21.1915, std.dev.: 0.5987)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.82% (1.6699 => 1.6395, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.11% (4.1462 => 4.1003, std.dev.: 0.0047)

Report Time: 0.63s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131128/6cb4bef2/attachment.html>


More information about the llvm-testresults mailing list