[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 19 11:50:16 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14573?compare_to=14569&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14573, Order: 188681, Start Time: 2013-08-19 17:03:01, End Time: 2013-08-19 18:52:22
      To: 14569, Order: 188675, Start Time: 2013-08-19 14:49:14, End Time: 2013-08-19 16:37:10
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 16 (33 on baseline)
Performance Improvements: 11 (33 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1080 (1041 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/office/office: 28.35% (0.2490 => 0.3196, std.dev.: 0.0096)
  MultiSource/Benchmarks/PAQ8p/paq8p: 9.61% (2.5846 => 2.8330, std.dev.: 0.0353)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.46% (1.4057 => 1.5105, std.dev.: 0.0379)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: 675.00% (0.0016 => 0.0124, std.dev.: 0.0016)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 637.50% (0.0024 => 0.0177, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 37.32% (0.0418 => 0.0574, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.24% (4.1207 => 4.8310, std.dev.: 0.0180)
  SingleSource/Benchmarks/Misc/fp-convert: 16.18% (6.9199 => 8.0392, std.dev.: 0.0135)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 10.24% (0.8340 => 0.9194, std.dev.: 0.0210)
  SingleSource/Benchmarks/Misc/salsa20: 8.32% (8.2780 => 8.9670, std.dev.: 0.0202)
  MultiSource/Applications/SIBsim4/SIBsim4: 5.56% (3.2893 => 3.4722, std.dev.: 0.0526)
  SingleSource/Benchmarks/Misc/flops: 4.38% (9.4081 => 9.8206, std.dev.: 0.0214)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.11% (16.0007 => 16.4989, std.dev.: 0.1191)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.71% (6.2974 => 6.4683, std.dev.: 0.0416)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.74% (1.6291 => 1.6574, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.70% (5.3657 => 5.4567, std.dev.: 0.0307)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -31.40% (0.4873 => 0.3343, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -18.76% (0.2170 => 0.1763, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -12.43% (1.7046 => 1.4927, std.dev.: 0.0718)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -9.93% (1.6167 => 1.4562, std.dev.: 0.0619)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.50% (17.1246 => 15.4982, std.dev.: 0.5671)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -4.24% (41.7526 => 39.9827, std.dev.: 0.6604)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.30% (5.1202 => 4.9514, std.dev.: 0.0515)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.17% (1.1134 => 1.0781, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.39% (3.5081 => 3.4243, std.dev.: 0.0309)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -2.13% (2.8768 => 2.8155, std.dev.: 0.0234)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.21% (1.8065 => 1.7847, std.dev.: 0.0041)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.35% (0.1334 => 0.1316, std.dev.: 0.0035)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/office/office: 31.14% (0.2437 => 0.3196, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.96% (1.5144 => 1.6501, std.dev.: 0.0310)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.95% (1.3993 => 1.5105, std.dev.: 0.0379)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.50% (2.6853 => 2.8330, std.dev.: 0.0353)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.34% (0.5292 => 0.5416, std.dev.: 0.0030)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.48% (3.7285 => 6.4683, std.dev.: 0.0416)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.54% (2.8867 => 4.2878, std.dev.: 0.0165)
  MultiSource/Benchmarks/FreeBench/neural/neural: 34.88% (0.3171 => 0.4277, std.dev.: 0.0341)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 25.64% (2.9428 => 3.6972, std.dev.: 0.1003)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.47% (1.5030 => 1.8858, std.dev.: 0.0526)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 25.33% (0.0458 => 0.0574, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout/hash: 23.62% (4.1846 => 5.1728, std.dev.: 0.3055)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.86% (7.0762 => 7.8445, std.dev.: 0.0367)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.30% (14.9584 => 16.4989, std.dev.: 0.1191)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.38% (1.2557 => 1.3609, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.32% (5.4910 => 5.9476, std.dev.: 0.0397)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.00% (48.3256 => 52.1916, std.dev.: 0.0207)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.92% (3.2027 => 3.4243, std.dev.: 0.0309)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.80% (3.4085 => 3.6403, std.dev.: 0.0408)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.28% (5.3042 => 5.6371, std.dev.: 0.0345)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.19% (5.5008 => 5.8413, std.dev.: 0.0447)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.02% (5.1471 => 5.4567, std.dev.: 0.0307)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.63% (3.3384 => 3.5263, std.dev.: 0.0379)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.26% (4.3151 => 4.4988, std.dev.: 0.0316)
  SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (3.3877 => 3.5241, std.dev.: 0.0165)
  SingleSource/Benchmarks/Misc/whetstone: 3.24% (3.4559 => 3.5679, std.dev.: 0.0196)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.24% (25.0200 => 25.8296, std.dev.: 0.0683)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.12% (4.8739 => 5.0261, std.dev.: 0.0206)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.70% (12.8625 => 13.2098, std.dev.: 0.0153)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.66% (1.4398 => 1.4637, std.dev.: 0.0014)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.33% (1.1618 => 1.1773, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.08% (3.0680 => 3.1011, std.dev.: 0.0121)
  SingleSource/Benchmarks/Shootout/methcall: 1.01% (8.4614 => 8.5469, std.dev.: 0.0085)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -34.96% (0.2237 => 0.1455, std.dev.: 0.0226)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -8.54% (0.3655 => 0.3343, std.dev.: 0.0042)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.03% (1.5376 => 1.5064, std.dev.: 0.0112)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.37% (2.1022 => 1.4217, std.dev.: 0.0033)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.76% (0.1189 => 0.0847, std.dev.: 0.0127)
  MultiSource/Applications/viterbi/viterbi: -27.19% (3.4923 => 2.5429, std.dev.: 0.0507)
  MultiSource/Applications/JM/ldecod/ldecod: -25.84% (0.0859 => 0.0637, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.61% (6.9552 => 5.2438, std.dev.: 0.0108)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6171, std.dev.: 0.0238)
  SingleSource/Benchmarks/Misc/mandel: -14.00% (1.1996 => 1.0316, std.dev.: 0.0149)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.44% (0.0884 => 0.0774, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.32% (6.2627 => 5.4909, std.dev.: 0.2902)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.62% (0.5173 => 0.4727, std.dev.: 0.0004)
  SingleSource/Regression/C/uint64_to_float: -5.70% (1.5184 => 1.4319, std.dev.: 0.0277)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.14% (0.7355 => 0.6977, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.75% (3.8119 => 3.6309, std.dev.: 0.0242)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.62% (47.2250 => 45.0417, std.dev.: 0.3092)
  SingleSource/Benchmarks/Misc/fbench: -4.56% (4.9602 => 4.7342, std.dev.: 0.0069)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.15% (1.1024 => 1.0566, std.dev.: 0.0053)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.74% (2.8052 => 2.7003, std.dev.: 0.0218)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.68% (1.7207 => 1.6574, std.dev.: 0.0083)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.49% (2.7049 => 2.6104, std.dev.: 0.0194)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.04% (0.7806 => 0.7569, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.03% (6.0444 => 5.8613, std.dev.: 0.0188)
  MultiSource/Applications/sgefa/sgefa: -2.53% (1.4030 => 1.3675, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.40% (6.1482 => 6.0004, std.dev.: 0.0156)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.37% (8.6172 => 8.4131, std.dev.: 0.0597)
  SingleSource/Benchmarks/Misc/oourafft: -2.15% (3.7891 => 3.7077, std.dev.: 0.0257)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.02% (34.8438 => 34.1386, std.dev.: 0.0538)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.67% (1.0964 => 1.0781, std.dev.: 0.0042)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.64% (1.8144 => 1.7847, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.39% (5.8810 => 5.7992, std.dev.: 0.0157)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.27% (2.1343 => 2.1073, std.dev.: 0.0023)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.50% (0.1378 => 0.1316, std.dev.: 0.0035)

Report Time: 0.92s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130819/a38e66ec/attachment.html>


More information about the llvm-testresults mailing list