[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Aug 15 03:02:26 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14433?compare_to=14429&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14433, Order: 188449, Start Time: 2013-08-15 08:16:37, End Time: 2013-08-15 10:04:25
      To: 14429, Order: 188444, Start Time: 2013-08-15 05:58:36, End Time: 2013-08-15 07:51:55
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 6 (32 on baseline)
Performance Improvements: 32 (48 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1069 (1027 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: 11.59% (0.4409 => 0.4920, std.dev.: 0.0118)
  SingleSource/Benchmarks/Misc/flops-4: 4.09% (1.5645 => 1.6285, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.12% (4.9846 => 5.0901, std.dev.: 0.0384)
  SingleSource/Benchmarks/Shootout/methcall: 1.86% (8.3763 => 8.5323, std.dev.: 0.0265)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.48% (3.5944 => 3.6475, std.dev.: 0.0178)
  SingleSource/Benchmarks/Shootout-C++/matrix: 1.38% (4.2838 => 4.3431, std.dev.: 0.0079)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -27.35% (0.8005 => 0.5816, std.dev.: 0.0388)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -26.04% (1.0099 => 0.7469, std.dev.: 0.0354)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -25.37% (0.9402 => 0.7017, std.dev.: 0.0431)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -24.05% (13.4114 => 10.1859, std.dev.: 0.4885)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.88% (6.2295 => 4.8040, std.dev.: 0.1929)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -22.25% (1.9915 => 1.5484, std.dev.: 0.1183)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -20.76% (7.4139 => 5.8748, std.dev.: 0.0648)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -20.73% (0.8943 => 0.7089, std.dev.: 0.0203)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -19.43% (2.0985 => 1.6908, std.dev.: 0.1042)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -18.94% (1.1084 => 0.8985, std.dev.: 0.0570)
  MultiSource/Benchmarks/Bullet/bullet: -11.45% (41.0453 => 36.3468, std.dev.: 1.2774)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -9.99% (1.4956 => 1.3462, std.dev.: 0.0176)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -9.66% (29.3574 => 26.5212, std.dev.: 1.0296)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -9.64% (1.5173 => 1.3711, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -9.55% (1.5843 => 1.4330, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -9.29% (1.7583 => 1.5949, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -7.57% (1.5802 => 1.4605, std.dev.: 0.0262)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -6.54% (1.7976 => 1.6801, std.dev.: 0.0218)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -6.29% (50.9025 => 47.7002, std.dev.: 0.5873)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.14% (1.4570 => 1.3821, std.dev.: 0.0194)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.77% (1.4541 => 1.3847, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.54% (1.5006 => 1.4325, std.dev.: 0.0158)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.15% (0.3275 => 0.3139, std.dev.: 0.0038)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -30.71% (0.2100 => 0.1455, std.dev.: 0.0024)
  MultiSource/Benchmarks/MallocBench/gs/gs: -21.74% (0.1081 => 0.0846, std.dev.: 0.0044)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -10.16% (0.1653 => 0.1485, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -4.33% (1.6806 => 1.6078, std.dev.: 0.0240)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.45% (1.6817 => 1.6236, std.dev.: 0.0058)
  MultiSource/Applications/hexxagon/hexxagon: -2.31% (15.8716 => 15.5051, std.dev.: 0.0113)
  SingleSource/Benchmarks/Dhrystone/dry: -2.17% (0.5112 => 0.5001, std.dev.: 0.0039)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.77% (1.2038 => 1.1825, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.52% (4.7044 => 4.6327, std.dev.: 0.0094)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.01% (0.1370 => 0.1315, std.dev.: 0.0162)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 39.91% (0.0466 => 0.0652, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/oourafft: 4.47% (0.2284 => 0.2386, std.dev.: 0.0020)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 72.61% (3.7285 => 6.4357, std.dev.: 0.0744)
  MultiSource/Benchmarks/FreeBench/neural/neural: 55.16% (0.3171 => 0.4920, std.dev.: 0.0118)
  SingleSource/Benchmarks/Shootout-C++/matrix: 50.45% (2.8867 => 4.3431, std.dev.: 0.0079)
  SingleSource/Benchmarks/Misc/pi: 26.97% (1.9835 => 2.5185, std.dev.: 0.0057)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.14% (1.5030 => 1.8809, std.dev.: 0.0073)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.01% (0.0526 => 0.0626, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/hash: 17.12% (0.6295 => 0.7373, std.dev.: 0.0166)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.82% (7.0762 => 7.8416, std.dev.: 0.0760)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.16% (0.1348 => 0.1485, std.dev.: 0.0003)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.58% (14.9584 => 16.3912, std.dev.: 0.2327)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.32% (5.4910 => 5.9480, std.dev.: 0.0164)
  MultiSource/Applications/JM/lencod/lencod: 8.20% (7.1799 => 7.7688, std.dev.: 0.1220)
  MultiSource/Benchmarks/FreeBench/mason/mason: 8.18% (0.2799 => 0.3028, std.dev.: 0.0069)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.91% (48.3256 => 52.1486, std.dev.: 0.0862)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.92% (3.2027 => 3.4243, std.dev.: 0.0186)
  MultiSource/Applications/siod/siod: 6.20% (3.3761 => 3.5853, std.dev.: 0.0582)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6220, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.90% (5.5008 => 5.8254, std.dev.: 0.1011)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.84% (3.4085 => 3.6075, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.33% (4.3151 => 4.5018, std.dev.: 0.0219)
  SingleSource/Benchmarks/Misc/whetstone: 4.27% (3.4559 => 3.6035, std.dev.: 0.0170)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3654, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.70% (3.3384 => 3.4620, std.dev.: 0.0012)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.27% (25.0200 => 25.8380, std.dev.: 0.0486)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.18% (3.5351 => 3.6475, std.dev.: 0.0178)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.17% (3.3877 => 3.4950, std.dev.: 0.0314)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.04% (4.8739 => 5.0219, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.17% (12.8625 => 13.1417, std.dev.: 0.0259)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.94% (1.4398 => 1.4678, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.75% (1.5957 => 1.6236, std.dev.: 0.0058)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.39% (0.2237 => 0.1490, std.dev.: 0.0161)
  MultiSource/Benchmarks/Olden/bisort/bisort: -31.25% (0.1072 => 0.0737, std.dev.: 0.0066)
  MultiSource/Benchmarks/Olden/tsp/tsp: -23.21% (0.1818 => 0.1396, std.dev.: 0.0108)
  MultiSource/Benchmarks/MallocBench/gs/gs: -21.17% (6.0938 => 4.8040, std.dev.: 0.1929)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.29% (1.5228 => 1.2138, std.dev.: 0.0054)
  MultiSource/Applications/lua/lua: -16.80% (5.3200 => 4.4262, std.dev.: 0.0145)
  MultiSource/Applications/hexxagon/hexxagon: -14.92% (1.3285 => 1.1303, std.dev.: 0.0171)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -13.23% (0.1141 => 0.0990, std.dev.: 0.0037)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.60% (1.3985 => 1.2223, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.38% (1.7797 => 1.5949, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.25% (1.4514 => 1.3462, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.14% (1.5426 => 1.4325, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.75% (1.5144 => 1.4122, std.dev.: 0.0254)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.40% (1.4794 => 1.3847, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.96% (1.5239 => 1.4330, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.72% (1.4333 => 1.3513, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.64% (1.5437 => 1.4566, std.dev.: 0.0188)
  MultiSource/Applications/minisat/minisat: -5.29% (0.8278 => 0.7840, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.07% (1.4940 => 1.4183, std.dev.: 0.0159)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.72% (1.4506 => 1.3821, std.dev.: 0.0194)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.68% (6.1631 => 5.8748, std.dev.: 0.0648)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -52.85% (0.0316 => 0.0149, std.dev.: 0.0044)
  MultiSource/Applications/lemon/lemon: -36.66% (1.4194 => 0.8991, std.dev.: 0.1928)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.41% (2.1022 => 1.4208, std.dev.: 0.0056)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.85% (0.1189 => 0.0846, std.dev.: 0.0044)
  MultiSource/Applications/viterbi/viterbi: -27.24% (3.4923 => 2.5409, std.dev.: 0.0502)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.65% (6.9552 => 5.2409, std.dev.: 0.0044)
  MultiSource/Applications/minisat/minisat: -22.40% (8.0162 => 6.2202, std.dev.: 0.1678)
  SingleSource/Benchmarks/Misc/perlin: -21.50% (4.5989 => 3.6100, std.dev.: 0.0158)
  SingleSource/Benchmarks/Misc/mandel: -14.58% (1.1996 => 1.0247, std.dev.: 0.0390)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.47% (0.5173 => 0.4683, std.dev.: 0.0108)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -7.67% (0.2047 => 0.1890, std.dev.: 0.0050)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.54% (3.5791 => 3.3091, std.dev.: 0.0878)
  SingleSource/Regression/C/uint64_to_float: -5.46% (1.5184 => 1.4355, std.dev.: 0.0231)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.28% (1.7207 => 1.6299, std.dev.: 0.0205)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -4.91% (21.6864 => 20.6218, std.dev.: 0.3897)
  SingleSource/Benchmarks/Misc/fbench: -4.52% (4.9602 => 4.7359, std.dev.: 0.0055)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.19% (0.7355 => 0.7047, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.15% (1.1024 => 1.0567, std.dev.: 0.0090)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.00% (47.2250 => 45.3360, std.dev.: 0.4332)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.42% (6.0444 => 5.8374, std.dev.: 0.0638)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.36% (2.7049 => 2.6141, std.dev.: 0.0294)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.02% (6.1482 => 5.9627, std.dev.: 0.0017)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.51% (0.7806 => 0.7610, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.39% (8.6172 => 8.4110, std.dev.: 0.0580)
  SingleSource/Benchmarks/Misc/oourafft: -2.31% (3.7891 => 3.7016, std.dev.: 0.0047)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.04% (34.8438 => 34.1323, std.dev.: 0.1041)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.56% (1.2012 => 1.1825, std.dev.: 0.0063)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.57% (0.1378 => 0.1315, std.dev.: 0.0162)

Report Time: 1.61s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130815/d338745d/attachment.html>


More information about the llvm-testresults mailing list