[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Aug 28 09:38:53 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14881?compare_to=14878&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14881, Order: 189480, Start Time: 2013-08-28 14:51:32, End Time: 2013-08-28 16:41:08
      To: 14878, Order: 189476, Start Time: 2013-08-28 12:44:39, End Time: 2013-08-28 14:28:09
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 6 (38 on baseline)
Performance Improvements: 1 (58 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1100 (1011 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.36% (0.2409 => 0.2514, std.dev.: 0.0006)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.27% (1.4803 => 1.8840, std.dev.: 0.0096)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 14.15% (0.7578 => 0.8650, std.dev.: 0.0414)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.72% (1.6291 => 1.6571, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc/pi: 1.46% (2.4864 => 2.5227, std.dev.: 0.0113)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 1.06% (2.4161 => 2.4418, std.dev.: 0.0028)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/ffbench: -1.59% (1.4108 => 1.3884, std.dev.: 0.0074)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.84% (0.1315 => 0.1304, std.dev.: 0.0305)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: 25.40% (0.2071 => 0.2597, std.dev.: 0.0077)
  SingleSource/Benchmarks/Misc/oourafft: 7.36% (0.2284 => 0.2452, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.09% (4.7710 => 4.9185, std.dev.: 0.0528)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.99% (1.1882 => 1.2119, std.dev.: 0.0085)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 78.51% (3.7285 => 6.6557, std.dev.: 0.0162)
  MultiSource/Benchmarks/FreeBench/neural/neural: 43.42% (0.3171 => 0.4548, std.dev.: 0.0314)
  SingleSource/Benchmarks/Misc/pi: 27.18% (1.9835 => 2.5227, std.dev.: 0.0113)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.35% (1.5030 => 1.8840, std.dev.: 0.0096)
  SingleSource/Benchmarks/Shootout/hash: 24.35% (4.1846 => 5.2036, std.dev.: 0.3001)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 22.93% (0.0458 => 0.0563, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.86% (9.6817 => 11.7014, std.dev.: 0.0474)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.31% (3.0680 => 3.5685, std.dev.: 0.0223)
  SingleSource/Benchmarks/Shootout-C++/hash: 15.84% (0.6295 => 0.7292, std.dev.: 0.0361)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 13.36% (4.6576 => 5.2797, std.dev.: 0.0374)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.04% (0.1678 => 0.1880, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.55% (4.9231 => 5.4919, std.dev.: 0.0219)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.11% (7.0762 => 7.8627, std.dev.: 0.0775)
  SingleSource/Benchmarks/Linpack/linpack-pc: 9.14% (48.3256 => 52.7427, std.dev.: 0.2678)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.38% (2.9467 => 3.1935, std.dev.: 0.0219)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.36% (1.2557 => 1.3607, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.32% (5.4910 => 5.9479, std.dev.: 0.0492)
  SingleSource/Benchmarks/Shootout/ary3: 8.00% (5.8158 => 6.2811, std.dev.: 0.0971)
  MultiSource/Applications/JM/lencod/lencod: 7.25% (7.1799 => 7.7004, std.dev.: 0.1659)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.29% (3.7593 => 3.9958, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.02% (5.3042 => 5.6235, std.dev.: 0.0674)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.80% (3.3464 => 3.5405, std.dev.: 0.0299)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.52% (3.4085 => 3.5968, std.dev.: 0.0384)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.47% (5.5008 => 5.8019, std.dev.: 0.0610)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.32% (4.9040 => 5.1650, std.dev.: 0.0699)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3651, std.dev.: 0.0259)
  SingleSource/Benchmarks/Misc/whetstone: 3.78% (3.4559 => 3.5866, std.dev.: 0.0487)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.49% (6.1245 => 6.3385, std.dev.: 0.0138)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.26% (25.0200 => 25.8358, std.dev.: 0.2030)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (3.3877 => 3.4872, std.dev.: 0.0337)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.89% (4.8739 => 5.0148, std.dev.: 0.0379)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 2.19% (2.3894 => 2.4418, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc/ffbench: 1.50% (1.3679 => 1.3884, std.dev.: 0.0074)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.04% (4.9089 => 4.9598, std.dev.: 0.0013)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -35.05% (0.2237 => 0.1453, std.dev.: 0.0060)
  MultiSource/Benchmarks/Olden/bisort/bisort: -33.86% (0.1072 => 0.0709, std.dev.: 0.0023)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -24.00% (0.0675 => 0.0513, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/tsp/tsp: -23.76% (0.1818 => 0.1386, std.dev.: 0.0026)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -22.71% (0.1114 => 0.0861, std.dev.: 0.0024)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -19.65% (1.5228 => 1.2235, std.dev.: 0.0241)
  MultiSource/Benchmarks/Olden/health/health: -19.62% (0.1993 => 0.1602, std.dev.: 0.0046)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -18.96% (0.3576 => 0.2898, std.dev.: 0.0228)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -17.19% (0.1518 => 0.1257, std.dev.: 0.0069)
  MultiSource/Applications/lua/lua: -16.66% (5.3200 => 4.4336, std.dev.: 0.0260)
  MultiSource/Applications/obsequi/Obsequi: -15.76% (1.4685 => 1.2370, std.dev.: 0.0040)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.51% (1.3985 => 1.2236, std.dev.: 0.0273)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.93% (0.1870 => 0.1647, std.dev.: 0.0050)
  MultiSource/Applications/lambda-0_1_3/lambda: -10.23% (0.9461 => 0.8493, std.dev.: 0.0199)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.55% (0.3655 => 0.3306, std.dev.: 0.0054)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -9.27% (0.3073 => 0.2788, std.dev.: 0.0024)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.25% (1.1012 => 0.9993, std.dev.: 0.0157)
  MultiSource/Applications/kimwitu++/kc: -6.94% (21.0770 => 19.6153, std.dev.: 0.5357)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.39% (1.5629 => 1.4943, std.dev.: 0.0244)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -3.23% (5.2851 => 5.1144, std.dev.: 0.0480)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.17% (0.7189 => 0.6961, std.dev.: 0.0078)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.63% (5.3476 => 5.2071, std.dev.: 0.0098)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.13% (1.5376 => 1.5049, std.dev.: 0.0053)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -36.85% (1.4194 => 0.8963, std.dev.: 0.0503)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.20% (2.1022 => 1.4252, std.dev.: 0.0518)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -31.00% (0.0816 => 0.0563, std.dev.: 0.0002)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.51% (0.9545 => 0.6728, std.dev.: 0.0324)
  MultiSource/Applications/viterbi/viterbi: -27.40% (3.4923 => 2.5354, std.dev.: 0.0538)
  SingleSource/Benchmarks/Misc/perlin: -21.45% (4.5989 => 3.6126, std.dev.: 0.0028)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -21.09% (1.0962 => 0.8650, std.dev.: 0.0414)
  MultiSource/Applications/obsequi/Obsequi: -17.88% (2.6081 => 2.1418, std.dev.: 0.0664)
  SingleSource/Benchmarks/Misc/mandel: -14.42% (1.1996 => 1.0266, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -13.93% (5.3098 => 4.5699, std.dev.: 0.0415)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.43% (0.3557 => 0.3115, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout-C++/matrix: -11.75% (2.8867 => 2.5476, std.dev.: 0.0733)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.53% (0.5173 => 0.4680, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.93% (0.3649 => 0.3323, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout/strcat: -8.35% (0.1593 => 0.1460, std.dev.: 0.0044)
  MultiSource/Applications/lua/lua: -7.30% (31.0707 => 28.8023, std.dev.: 0.4470)
  MultiSource/Benchmarks/Olden/health/health: -6.75% (0.3556 => 0.3316, std.dev.: 0.0085)
  SingleSource/Benchmarks/Misc/fp-convert: -6.58% (8.0730 => 7.5420, std.dev.: 0.0499)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -5.13% (21.6864 => 20.5736, std.dev.: 0.2689)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.88% (0.7355 => 0.6996, std.dev.: 0.0025)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.69% (2.7049 => 2.5780, std.dev.: 0.0156)
  SingleSource/Benchmarks/Misc/fbench: -4.36% (4.9602 => 4.7437, std.dev.: 0.0067)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -4.32% (0.3773 => 0.3610, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.14% (3.8119 => 3.6541, std.dev.: 0.0084)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.94% (0.6480 => 0.6225, std.dev.: 0.0068)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.70% (1.7207 => 1.6571, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.41% (6.0444 => 5.8382, std.dev.: 0.0409)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.20% (5.0417 => 4.8805, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9621, std.dev.: 0.0480)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.41% (47.2250 => 46.0859, std.dev.: 0.2817)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.31% (8.6172 => 8.4178, std.dev.: 0.0271)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.02% (3.5516 => 3.4800, std.dev.: 0.0141)
  SingleSource/Benchmarks/Misc/oourafft: -2.01% (3.7891 => 3.7130, std.dev.: 0.0107)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.96% (34.8438 => 34.1598, std.dev.: 0.2169)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.46% (1.6737 => 1.6492, std.dev.: 0.0031)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.37% (0.1378 => 0.1304, std.dev.: 0.0305)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130828/726400b9/attachment.html>


More information about the llvm-testresults mailing list