[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu May 23 13:35:01 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11685?compare_to=11681&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11685, Order: 182597, Start Time: 2013-05-23 18:48:33, End Time: 2013-05-23 20:35:26
      To: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 15 (15 on baseline)
Performance Improvements: 34 (34 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1058 (1058 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.04% (4.1734 => 4.5507, std.dev.: 0.0417)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.14% (2.6076 => 2.8199, std.dev.: 0.0168)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.10% (1.9079 => 2.0624, std.dev.: 0.0153)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.88% (6.6236 => 6.8808, std.dev.: 0.0843)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 51.46% (6.0122 => 9.1058, std.dev.: 0.3493)
  SingleSource/Benchmarks/Shootout-C++/ary: 15.96% (0.0633 => 0.0734, std.dev.: 0.0026)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.86% (2.5087 => 2.6306, std.dev.: 0.0309)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.37% (0.9806 => 1.0235, std.dev.: 0.0087)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.06% (1.0571 => 1.1000, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.10% (4.6452 => 4.7893, std.dev.: 0.0221)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.06% (3.9713 => 4.0928, std.dev.: 0.0395)
  SingleSource/Benchmarks/Misc/ffbench: 2.58% (1.3696 => 1.4049, std.dev.: 0.0093)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.21% (21.4874 => 21.9614, std.dev.: 0.1594)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.74% (3.5327 => 3.5940, std.dev.: 0.0121)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (16.5355 => 16.7226, std.dev.: 0.0378)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.07% (0.7918 => 0.6725, std.dev.: 0.0132)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -14.07% (0.1322 => 0.1136, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.56% (0.1151 => 0.1018, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.48% (0.1646 => 0.1457, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -11.35% (0.1075 => 0.0953, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -11.02% (0.8025 => 0.7141, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.68% (1.5932 => 1.4230, std.dev.: 0.0362)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.18% (5.1587 => 4.6338, std.dev.: 0.1774)
  MultiSource/Applications/aha/aha: -9.88% (0.1407 => 0.1268, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.62% (1.7804 => 1.6091, std.dev.: 0.0090)
  MultiSource/Applications/lemon/lemon: -7.64% (1.3155 => 1.2150, std.dev.: 0.0298)
  MultiSource/Applications/Burg/burg: -7.17% (1.5375 => 1.4273, std.dev.: 0.0096)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.10% (0.7381 => 0.6857, std.dev.: 0.0200)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.56% (2.0439 => 1.9098, std.dev.: 0.0391)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -6.52% (0.1886 => 0.1763, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.09% (0.4030 => 0.3825, std.dev.: 0.0040)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.32% (0.9964 => 0.9534, std.dev.: 0.0096)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.75% (0.5887 => 0.5666, std.dev.: 0.0083)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.37% (0.3853 => 0.3723, std.dev.: 0.0028)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.84% (1.1954 => 1.1615, std.dev.: 0.0061)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.29% (1.2006 => 1.1731, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.83% (1.7006 => 1.6695, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.58% (0.8969 => 0.8827, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.48% (1.4771 => 1.4553, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.32% (1.5478 => 1.5273, std.dev.: 0.0053)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.21% (1.4253 => 1.4081, std.dev.: 0.0056)
  MultiSource/Benchmarks/nbench/nbench: -1.03% (1.2926 => 1.2793, std.dev.: 0.0034)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/hash: -7.73% (0.7941 => 0.7327, std.dev.: 0.0183)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.93% (2.5366 => 2.4116, std.dev.: 0.0135)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -4.79% (3.5120 => 3.3436, std.dev.: 0.0407)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.17% (0.4988 => 0.4880, std.dev.: 0.0011)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.94% (94.2966 => 92.4691, std.dev.: 0.3630)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.34% (2.8573 => 2.8189, std.dev.: 0.0034)
  MultiSource/Applications/aha/aha: -1.04% (3.6251 => 3.5874, std.dev.: 0.0052)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.29% (0.1441 => 0.1474, std.dev.: 0.0341)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.04% (4.1734 => 4.5507, std.dev.: 0.0417)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.14% (2.6076 => 2.8199, std.dev.: 0.0168)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.10% (1.9079 => 2.0624, std.dev.: 0.0153)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.88% (6.6236 => 6.8808, std.dev.: 0.0843)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 51.46% (6.0122 => 9.1058, std.dev.: 0.3493)
  SingleSource/Benchmarks/Shootout-C++/ary: 15.96% (0.0633 => 0.0734, std.dev.: 0.0026)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.86% (2.5087 => 2.6306, std.dev.: 0.0309)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.37% (0.9806 => 1.0235, std.dev.: 0.0087)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.06% (1.0571 => 1.1000, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.10% (4.6452 => 4.7893, std.dev.: 0.0221)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.06% (3.9713 => 4.0928, std.dev.: 0.0395)
  SingleSource/Benchmarks/Misc/ffbench: 2.58% (1.3696 => 1.4049, std.dev.: 0.0093)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.21% (21.4874 => 21.9614, std.dev.: 0.1594)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.74% (3.5327 => 3.5940, std.dev.: 0.0121)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (16.5355 => 16.7226, std.dev.: 0.0378)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.07% (0.7918 => 0.6725, std.dev.: 0.0132)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -14.07% (0.1322 => 0.1136, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.56% (0.1151 => 0.1018, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.48% (0.1646 => 0.1457, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -11.35% (0.1075 => 0.0953, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -11.02% (0.8025 => 0.7141, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.68% (1.5932 => 1.4230, std.dev.: 0.0362)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.18% (5.1587 => 4.6338, std.dev.: 0.1774)
  MultiSource/Applications/aha/aha: -9.88% (0.1407 => 0.1268, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.62% (1.7804 => 1.6091, std.dev.: 0.0090)
  MultiSource/Applications/lemon/lemon: -7.64% (1.3155 => 1.2150, std.dev.: 0.0298)
  MultiSource/Applications/Burg/burg: -7.17% (1.5375 => 1.4273, std.dev.: 0.0096)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.10% (0.7381 => 0.6857, std.dev.: 0.0200)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.56% (2.0439 => 1.9098, std.dev.: 0.0391)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -6.52% (0.1886 => 0.1763, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.09% (0.4030 => 0.3825, std.dev.: 0.0040)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.32% (0.9964 => 0.9534, std.dev.: 0.0096)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.75% (0.5887 => 0.5666, std.dev.: 0.0083)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.37% (0.3853 => 0.3723, std.dev.: 0.0028)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.84% (1.1954 => 1.1615, std.dev.: 0.0061)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.29% (1.2006 => 1.1731, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.83% (1.7006 => 1.6695, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.58% (0.8969 => 0.8827, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.48% (1.4771 => 1.4553, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.32% (1.5478 => 1.5273, std.dev.: 0.0053)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.21% (1.4253 => 1.4081, std.dev.: 0.0056)
  MultiSource/Benchmarks/nbench/nbench: -1.03% (1.2926 => 1.2793, std.dev.: 0.0034)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/hash: -7.73% (0.7941 => 0.7327, std.dev.: 0.0183)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.93% (2.5366 => 2.4116, std.dev.: 0.0135)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -4.79% (3.5120 => 3.3436, std.dev.: 0.0407)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.17% (0.4988 => 0.4880, std.dev.: 0.0011)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.94% (94.2966 => 92.4691, std.dev.: 0.3630)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.34% (2.8573 => 2.8189, std.dev.: 0.0034)
  MultiSource/Applications/aha/aha: -1.04% (3.6251 => 3.5874, std.dev.: 0.0052)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.29% (0.1441 => 0.1474, std.dev.: 0.0341)

Report Time: 0.29s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130523/46ca04c4/attachment.html>


More information about the llvm-testresults mailing list