[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 26 05:01:34 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14798?compare_to=14794&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14798, Order: 189212, Start Time: 2013-08-26 10:16:44, End Time: 2013-08-26 12:03:47
      To: 14794, Order: 189210, Start Time: 2013-08-26 08:06:20, End Time: 2013-08-26 09:53:26
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 11 (32 on baseline)
Performance Improvements: 1 (82 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1095 (993 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.70% (0.2296 => 0.2404, std.dev.: 0.0026)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.53% (1.3348 => 1.3552, std.dev.: 0.0014)
  MultiSource/Applications/oggenc/oggenc: 1.49% (5.7592 => 5.8452, std.dev.: 0.0231)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 10.41% (0.2633 => 0.2907, std.dev.: 0.0074)
  MultiSource/Benchmarks/nbench/nbench: 10.25% (20.3766 => 22.4659, std.dev.: 0.4463)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.06% (15.4015 => 16.7963, std.dev.: 0.1373)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.21% (0.8426 => 0.8949, std.dev.: 0.0109)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.52% (1.1091 => 1.1703, std.dev.: 0.0014)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 1.53% (0.7500 => 0.7615, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/ReedSolomon: 1.19% (8.4187 => 8.5186, std.dev.: 0.0372)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.09% (51.5946 => 52.1560, std.dev.: 0.0696)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.37% (3.6522 => 3.6021, std.dev.: 0.0015)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: - (0.1302 => 0.1302, std.dev.: 0.0015)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: 20.62% (0.1033 => 0.1246, std.dev.: 0.0006)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.66% (0.9941 => 1.0404, std.dev.: 0.0027)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.98% (0.9407 => 0.9687, std.dev.: 0.0071)
  MultiSource/Benchmarks/sim/sim: 2.76% (0.3808 => 0.3913, std.dev.: 0.0006)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.30% (3.7285 => 6.2376, std.dev.: 0.1288)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.56% (2.8867 => 4.2884, std.dev.: 0.0094)
  MultiSource/Benchmarks/FreeBench/neural/neural: 35.10% (0.3171 => 0.4284, std.dev.: 0.0099)
  SingleSource/Benchmarks/Misc/pi: 27.48% (1.9835 => 2.5286, std.dev.: 0.0216)
  SingleSource/Benchmarks/Shootout/hash: 23.04% (4.1846 => 5.1487, std.dev.: 0.1203)
  SingleSource/Benchmarks/Shootout-C++/hash: 15.74% (0.6295 => 0.7286, std.dev.: 0.0358)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.29% (14.9584 => 16.7963, std.dev.: 0.1373)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.05% (7.0762 => 7.8583, std.dev.: 0.0676)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.59% (0.1678 => 0.1839, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 8.51% (0.2679 => 0.2907, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.30% (5.4910 => 5.9469, std.dev.: 0.0209)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.93% (48.3256 => 52.1560, std.dev.: 0.0696)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.92% (1.2557 => 1.3551, std.dev.: 0.0000)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.93% (3.2027 => 3.4246, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6218, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.90% (3.3877 => 3.5875, std.dev.: 0.0752)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.68% (3.4085 => 3.6021, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.47% (5.5008 => 5.8017, std.dev.: 0.0959)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.04% (1.1142 => 1.1703, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/tsp/tsp: 4.67% (1.5339 => 1.6056, std.dev.: 0.0266)
  MultiSource/Applications/siod/siod: 4.53% (3.3761 => 3.5290, std.dev.: 0.0231)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3653, std.dev.: 0.0493)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.09% (4.3151 => 4.4918, std.dev.: 0.0172)
  SingleSource/Benchmarks/Misc/whetstone: 3.78% (3.4559 => 3.5866, std.dev.: 0.0189)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.73% (3.3384 => 3.4628, std.dev.: 0.0013)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.27% (25.0200 => 25.8380, std.dev.: 0.0480)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.00% (4.8739 => 5.0203, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.22% (9.7023 => 9.8209, std.dev.: 0.0352)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -38.43% (0.1072 => 0.0660, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/power/power: -34.73% (0.2237 => 0.1460, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -28.01% (0.1114 => 0.0802, std.dev.: 0.0071)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -25.93% (0.0675 => 0.0500, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/tsp/tsp: -23.82% (0.1818 => 0.1385, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -23.23% (0.0439 => 0.0337, std.dev.: 0.0017)
  MultiSource/Benchmarks/MallocBench/gs/gs: -21.87% (6.0938 => 4.7611, std.dev.: 0.0509)
  MultiSource/Benchmarks/Olden/health/health: -21.48% (0.1993 => 0.1565, std.dev.: 0.0027)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -19.94% (1.5228 => 1.2192, std.dev.: 0.0556)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -18.46% (0.3576 => 0.2916, std.dev.: 0.0014)
  MultiSource/Applications/obsequi/Obsequi: -17.88% (1.4685 => 1.2059, std.dev.: 0.0587)
  MultiSource/Applications/lua/lua: -16.70% (5.3200 => 4.4317, std.dev.: 0.1673)
  MultiSource/Applications/hbd/hbd: -15.33% (2.0193 => 1.7097, std.dev.: 0.0217)
  MultiSource/Benchmarks/Olden/em3d/em3d: -13.94% (0.2367 => 0.2037, std.dev.: 0.0019)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.76% (1.3985 => 1.2200, std.dev.: 0.0306)
  MultiSource/Applications/sgefa/sgefa: -12.62% (0.4809 => 0.4202, std.dev.: 0.0082)
  MultiSource/Applications/ClamAV/clamscan: -10.69% (19.4145 => 17.3385, std.dev.: 0.0150)
  MultiSource/Applications/JM/ldecod/ldecod: -10.13% (8.6720 => 7.7931, std.dev.: 0.0856)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -9.73% (0.1141 => 0.1030, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -9.48% (1.7797 => 1.6110, std.dev.: 0.0072)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -7.96% (0.1947 => 0.1792, std.dev.: 0.0017)
  MultiSource/Applications/kimwitu++/kc: -7.15% (21.0770 => 19.5709, std.dev.: 0.1594)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.81% (1.4514 => 1.3525, std.dev.: 0.0220)
  MultiSource/Applications/siod/siod: -6.81% (2.7150 => 2.5301, std.dev.: 0.0406)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.46% (1.5345 => 1.4354, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.38% (1.5426 => 1.4442, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.86% (1.5815 => 1.4889, std.dev.: 0.0169)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.81% (1.4794 => 1.3935, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.49% (1.6226 => 1.5336, std.dev.: 0.0137)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.37% (1.4333 => 1.3563, std.dev.: 0.0057)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.92% (6.1631 => 5.8599, std.dev.: 0.0124)
  MultiSource/Benchmarks/Olden/bh/bh: -4.86% (0.3603 => 0.3428, std.dev.: 0.0025)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.82% (1.7461 => 1.6620, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.68% (1.5239 => 1.4526, std.dev.: 0.0139)
  MultiSource/Applications/oggenc/oggenc: -4.37% (6.1121 => 5.8452, std.dev.: 0.0231)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.30% (1.4506 => 1.3882, std.dev.: 0.0027)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.96% (27.6418 => 26.5482, std.dev.: 0.3542)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.35% (1.4166 => 1.3691, std.dev.: 0.0158)
  MultiSource/Applications/SPASS/SPASS: -3.33% (17.9111 => 17.3145, std.dev.: 0.0373)
  MultiSource/Benchmarks/McCat/18-imp/imp: -2.82% (0.4153 => 0.4036, std.dev.: 0.0032)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (1.3780 => 1.3552, std.dev.: 0.0014)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -37.77% (0.2134 => 0.1328, std.dev.: 0.0011)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.35% (2.1022 => 1.4221, std.dev.: 0.0043)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -30.53% (1.0962 => 0.7615, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -29.66% (0.0816 => 0.0574, std.dev.: 0.0046)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.29% (0.9545 => 0.6749, std.dev.: 0.0086)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.43% (0.1189 => 0.0851, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/ary2: -27.78% (0.0414 => 0.0299, std.dev.: 0.0030)
  MultiSource/Applications/viterbi/viterbi: -27.22% (3.4923 => 2.5418, std.dev.: 0.0267)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -23.34% (6.9552 => 5.3318, std.dev.: 0.3059)
  SingleSource/Benchmarks/Misc/perlin: -21.38% (4.5989 => 3.6155, std.dev.: 0.0095)
  MultiSource/Applications/obsequi/Obsequi: -18.88% (2.6081 => 2.1158, std.dev.: 0.0720)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.08% (0.0884 => 0.0733, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/mandel: -14.84% (1.1996 => 1.0216, std.dev.: 0.0339)
  MultiSource/Applications/SPASS/SPASS: -13.55% (9.2220 => 7.9720, std.dev.: 0.3583)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.48% (0.3557 => 0.3113, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.80% (6.2627 => 5.5235, std.dev.: 0.1240)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.26% (0.5173 => 0.4694, std.dev.: 0.0186)
  SingleSource/Benchmarks/Shootout/strcat: -8.73% (0.1593 => 0.1454, std.dev.: 0.0016)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.81% (3.5791 => 3.2997, std.dev.: 0.0168)
  MultiSource/Benchmarks/Olden/health/health: -7.11% (0.3556 => 0.3303, std.dev.: 0.0064)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.11% (47.2250 => 44.3372, std.dev.: 0.9527)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.60% (1.7207 => 1.6244, std.dev.: 0.0233)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.01% (0.3773 => 0.3584, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc/fbench: -4.62% (4.9602 => 4.7312, std.dev.: 0.0154)
  MultiSource/Applications/lua/lua: -4.59% (31.0707 => 29.6443, std.dev.: 0.4144)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.49% (2.7049 => 2.5834, std.dev.: 0.0460)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.43% (0.7355 => 0.7029, std.dev.: 0.0028)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.31% (0.3479 => 0.3329, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.17% (1.1024 => 1.0564, std.dev.: 0.0049)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.42% (21.6864 => 20.9438, std.dev.: 0.2728)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.41% (6.0444 => 5.8384, std.dev.: 0.0068)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.19% (1.8144 => 1.7565, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.13% (5.2218 => 5.0586, std.dev.: 0.0234)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9620, std.dev.: 0.0314)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -2.97% (0.4783 => 0.4641, std.dev.: 0.0026)
  MultiSource/Benchmarks/Olden/bh/bh: -2.86% (2.4879 => 2.4167, std.dev.: 0.0052)
  MultiSource/Applications/sgefa/sgefa: -2.47% (1.4030 => 1.3684, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.24% (2.8052 => 2.7424, std.dev.: 0.0149)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.02% (34.8438 => 34.1399, std.dev.: 0.2603)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (5.8810 => 5.7951, std.dev.: 0.0238)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.14% (8.6172 => 8.5186, std.dev.: 0.0372)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.52% (0.1378 => 0.1302, std.dev.: 0.0015)

Report Time: 0.69s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130826/9e81d270/attachment.html>


More information about the llvm-testresults mailing list