[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Aug 23 10:39:52 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14714?compare_to=14709&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14714, Order: 189108, Start Time: 2013-08-23 15:51:56, End Time: 2013-08-23 17:42:02
      To: 14709, Order: 189106, Start Time: 2013-08-23 12:58:36, End Time: 2013-08-23 14:40:18
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 15 (35 on baseline)
Performance Improvements: 0 (45 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1092 (1027 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/oggenc/oggenc: 2.81% (5.7680 => 5.9303, std.dev.: 0.0601)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.74% (1.3711 => 1.3949, std.dev.: 0.0039)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 51.16% (1.6484 => 2.4917, std.dev.: 0.0314)
  SingleSource/Benchmarks/Shootout/ary3: 43.70% (5.8083 => 8.3465, std.dev.: 0.4692)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.60% (1.4723 => 1.8640, std.dev.: 0.0137)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.04% (4.1236 => 4.8261, std.dev.: 0.0143)
  MultiSource/Benchmarks/Olden/em3d/em3d: 8.45% (4.7697 => 5.1729, std.dev.: 0.0456)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 7.86% (0.2137 => 0.2305, std.dev.: 0.0018)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.34% (14.9126 => 15.8587, std.dev.: 0.2195)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.24% (6.2334 => 6.4979, std.dev.: 0.0456)
  MultiSource/Applications/siod/siod: 2.65% (3.5402 => 3.6340, std.dev.: 0.0203)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.09% (1.5887 => 1.6219, std.dev.: 0.0116)
  SingleSource/Benchmarks/Misc/whetstone: 1.26% (3.5716 => 3.6165, std.dev.: 0.0004)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.24% (1.6308 => 1.6511, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.16% (3.0774 => 3.1130, std.dev.: 0.0014)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.30% (0.1338 => 0.1334, std.dev.: 0.0224)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 46.57% (0.0466 => 0.0683, std.dev.: 0.0033)
  MultiSource/Benchmarks/FreeBench/distray/distray: 20.04% (0.1033 => 0.1240, std.dev.: 0.0061)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 74.28% (3.7285 => 6.4979, std.dev.: 0.0456)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.43% (2.8867 => 4.2847, std.dev.: 0.0092)
  SingleSource/Benchmarks/Shootout/ary3: 43.51% (5.8158 => 8.3465, std.dev.: 0.4692)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 27.08% (2.9428 => 3.7396, std.dev.: 0.2055)
  SingleSource/Benchmarks/Misc/pi: 25.62% (1.9835 => 2.4917, std.dev.: 0.0314)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.02% (1.5030 => 1.8640, std.dev.: 0.0137)
  SingleSource/Benchmarks/Shootout/hash: 23.71% (4.1846 => 5.1767, std.dev.: 0.0693)
  SingleSource/Benchmarks/Shootout-C++/hash: 17.24% (0.6295 => 0.7380, std.dev.: 0.0288)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.93% (7.0762 => 7.8498, std.dev.: 0.0646)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.39% (1.2557 => 1.3610, std.dev.: 0.0260)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.32% (5.4910 => 5.9480, std.dev.: 0.0250)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.14% (48.3256 => 52.2586, std.dev.: 0.1606)
  MultiSource/Applications/siod/siod: 7.64% (3.3761 => 3.6340, std.dev.: 0.0203)
  MultiSource/Applications/JM/lencod/lencod: 7.49% (7.1799 => 7.7174, std.dev.: 0.1767)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.90% (3.2027 => 3.4237, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 6.66% (0.2161 => 0.2305, std.dev.: 0.0018)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.02% (14.9584 => 15.8587, std.dev.: 0.2195)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.87% (5.3042 => 5.6154, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.72% (3.4085 => 3.6033, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.47% (5.5008 => 5.8016, std.dev.: 0.0210)
  SingleSource/Benchmarks/Misc/whetstone: 4.65% (3.4559 => 3.6165, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.30% (4.3151 => 4.5008, std.dev.: 0.0536)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.84% (3.3384 => 3.4666, std.dev.: 0.0240)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.71% (6.1245 => 6.3516, std.dev.: 0.0295)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.53% (1.2639 => 1.3085, std.dev.: 0.0162)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.29% (25.0200 => 25.8428, std.dev.: 0.0856)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.02% (3.3877 => 3.4899, std.dev.: 0.0221)
  SingleSource/Benchmarks/Shootout/matrix: 2.17% (1.7358 => 1.7734, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.56% (5.0417 => 5.1203, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.47% (3.0680 => 3.1130, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.46% (4.9089 => 4.9807, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.10% (4.9040 => 4.9577, std.dev.: 0.0199)
  SingleSource/Benchmarks/Misc/flops: 1.02% (9.7664 => 9.8657, std.dev.: 0.0318)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -30.22% (0.1072 => 0.0748, std.dev.: 0.0077)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -22.96% (0.0675 => 0.0520, std.dev.: 0.0055)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.17% (1.5228 => 1.2156, std.dev.: 0.0242)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -17.72% (0.1518 => 0.1249, std.dev.: 0.0013)
  MultiSource/Applications/lua/lua: -16.37% (5.3200 => 4.4492, std.dev.: 0.0907)
  MultiSource/Applications/hbd/hbd: -15.86% (2.0193 => 1.6991, std.dev.: 0.0711)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.23% (1.3985 => 1.2275, std.dev.: 0.0518)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.41% (0.7091 => 0.6282, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.86% (1.4514 => 1.3518, std.dev.: 0.0190)
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.78% (2.6853 => 2.5301, std.dev.: 0.0451)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.69% (1.5815 => 1.4915, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.59% (1.5345 => 1.4487, std.dev.: 0.0124)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.56% (0.2498 => 0.2359, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.67% (1.4947 => 1.4398, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.22% (1.5479 => 1.4981, std.dev.: 0.0188)
  MultiSource/Applications/oggenc/oggenc: -2.97% (6.1121 => 5.9303, std.dev.: 0.0601)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.72% (1.4339 => 1.3949, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.62% (1.5357 => 1.4955, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.97% (1.3649 => 1.3380, std.dev.: 0.0032)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -46.20% (0.0316 => 0.0170, std.dev.: 0.0035)
  MultiSource/Applications/lemon/lemon: -32.65% (1.4194 => 0.9560, std.dev.: 0.0580)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.94% (2.1022 => 1.4307, std.dev.: 0.1807)
  MultiSource/Applications/viterbi/viterbi: -27.29% (3.4923 => 2.5392, std.dev.: 0.2269)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.62% (6.9552 => 5.2429, std.dev.: 0.0232)
  MultiSource/Applications/minisat/minisat: -21.94% (8.0162 => 6.2578, std.dev.: 0.6753)
  SingleSource/Benchmarks/Misc/perlin: -21.31% (4.5989 => 3.6191, std.dev.: 0.0205)
  SingleSource/Benchmarks/Misc/mandel: -14.26% (1.1996 => 1.0285, std.dev.: 0.0113)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.33% (0.0884 => 0.0775, std.dev.: 0.0013)
  MultiSource/Applications/SPASS/SPASS: -7.69% (9.2220 => 8.5124, std.dev.: 0.2640)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.81% (3.5791 => 3.3353, std.dev.: 0.0735)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -5.57% (0.4969 => 0.4692, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/fbench: -4.48% (4.9602 => 4.7380, std.dev.: 0.0058)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.31% (47.2250 => 45.1884, std.dev.: 0.6271)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -4.04% (1.7207 => 1.6511, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.36% (6.0444 => 5.8412, std.dev.: 0.0233)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.34% (21.6864 => 20.9617, std.dev.: 0.2159)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.05% (6.1482 => 5.9604, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.65% (5.2218 => 5.0836, std.dev.: 0.0136)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.56% (0.7806 => 0.7606, std.dev.: 0.0061)
  MultiSource/Applications/sgefa/sgefa: -2.11% (1.4030 => 1.3734, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.02% (8.6172 => 8.4434, std.dev.: 0.0461)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.99% (34.8438 => 34.1509, std.dev.: 0.0495)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.50% (5.0180 => 4.9425, std.dev.: 0.0206)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.47% (5.8810 => 5.7948, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.35% (4.9231 => 4.8567, std.dev.: 0.0233)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.19% (0.1378 => 0.1334, std.dev.: 0.0224)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130823/04fe1309/attachment.html>


More information about the llvm-testresults mailing list