[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Aug 27 05:54:54 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14839?compare_to=14835&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14839, Order: 189335, Start Time: 2013-08-27 11:07:00, End Time: 2013-08-27 12:57:07
      To: 14835, Order: 189324, Start Time: 2013-08-27 08:43:48, End Time: 2013-08-27 10:39:17
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 7 (34 on baseline)
Performance Improvements: 32 (39 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1068 (1034 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/constpool: 33.46% (8.8007 => 11.7454, std.dev.: 0.9702)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 52.93% (1.6569 => 2.5339, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/fibo: 15.73% (4.1762 => 4.8333, std.dev.: 0.0345)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.85% (2.3471 => 2.6957, std.dev.: 0.1143)
  SingleSource/Benchmarks/Misc/salsa20: 10.34% (8.1353 => 8.9768, std.dev.: 0.1392)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.74% (5.1759 => 5.3175, std.dev.: 0.0131)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.17% (20.5442 => 20.9910, std.dev.: 0.1613)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/spiff/spiff: -31.55% (1.4183 => 0.9708, std.dev.: 0.0195)
  MultiSource/Applications/Burg/burg: -29.50% (2.0921 => 1.4750, std.dev.: 0.0441)
  MultiSource/Applications/treecc/treecc: -24.11% (3.1108 => 2.3608, std.dev.: 0.0365)
  MultiSource/Applications/viterbi/viterbi: -20.42% (0.2429 => 0.1933, std.dev.: 0.0167)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -19.02% (0.0899 => 0.0728, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -18.15% (0.0661 => 0.0541, std.dev.: 0.0030)
  MultiSource/Applications/SPASS/SPASS: -15.96% (20.6667 => 17.3684, std.dev.: 0.8765)
  MultiSource/Applications/siod/siod: -15.78% (3.0106 => 2.5355, std.dev.: 0.0605)
  MultiSource/Applications/d/make_dparser: -15.10% (4.4939 => 3.8151, std.dev.: 0.0667)
  MultiSource/Applications/JM/ldecod/ldecod: -15.00% (9.2392 => 7.8529, std.dev.: 0.5178)
  MultiSource/Applications/aha/aha: -14.94% (0.1553 => 0.1321, std.dev.: 0.0024)
  MultiSource/Applications/sgefa/sgefa: -14.51% (0.4727 => 0.4041, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -13.48% (5.7258 => 4.9541, std.dev.: 0.0053)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -12.37% (8.9085 => 7.8066, std.dev.: 0.0092)
  MultiSource/Benchmarks/PAQ8p/paq8p: -11.65% (2.9803 => 2.6332, std.dev.: 0.1219)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -10.93% (0.1043 => 0.0929, std.dev.: 0.0042)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -10.08% (0.5971 => 0.5369, std.dev.: 0.0231)
  MultiSource/Applications/oggenc/oggenc: -10.03% (6.5392 => 5.8830, std.dev.: 0.0790)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -7.54% (5.5992 => 5.1768, std.dev.: 0.0256)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.71% (0.2951 => 0.2812, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.64% (0.7262 => 0.7143, std.dev.: 0.0040)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/d/make_dparser: -29.56% (0.0548 => 0.0386, std.dev.: 0.0001)
  MultiSource/Applications/SPASS/SPASS: -22.84% (10.6759 => 8.2373, std.dev.: 0.4099)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -15.88% (0.3489 => 0.2935, std.dev.: 0.0211)
  MultiSource/Benchmarks/Olden/em3d/em3d: -4.83% (5.2654 => 5.0113, std.dev.: 0.0830)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.49% (0.3764 => 0.3595, std.dev.: 0.0024)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.10% (1.1055 => 1.0602, std.dev.: 0.0028)
  MultiSource/Applications/siod/siod: -4.01% (3.6721 => 3.5248, std.dev.: 0.0515)
  MultiSource/Applications/aha/aha: -2.54% (3.6830 => 3.5895, std.dev.: 0.0071)
  MultiSource/Applications/spiff/spiff: -1.86% (2.8863 => 2.8325, std.dev.: 0.0059)
  MultiSource/Applications/sgefa/sgefa: -1.45% (1.6230 => 1.5994, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.05% (5.0796 => 5.0263, std.dev.: 0.0121)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.15% (0.1346 => 0.1344, std.dev.: 0.0025)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/constpool: 32.52% (8.8630 => 11.7454, std.dev.: 0.9702)
  MultiSource/Benchmarks/FreeBench/neural/neural: 24.29% (0.2071 => 0.2574, std.dev.: 0.0134)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (4.7710 => 4.9541, std.dev.: 0.0053)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.90% (0.7010 => 0.7143, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.49% (0.7194 => 0.7301, std.dev.: 0.0037)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.34% (7.7035 => 7.8066, std.dev.: 0.0092)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 78.36% (3.7285 => 6.6502, std.dev.: 0.0751)
  MultiSource/Benchmarks/FreeBench/neural/neural: 40.30% (0.3171 => 0.4449, std.dev.: 0.0113)
  SingleSource/Benchmarks/Misc/pi: 27.75% (1.9835 => 2.5339, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout/hash: 25.24% (4.1846 => 5.2406, std.dev.: 0.3426)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.82% (9.6817 => 11.6976, std.dev.: 0.0480)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.76% (0.6295 => 0.7350, std.dev.: 0.0264)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.60% (3.0680 => 3.5774, std.dev.: 0.1360)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.68% (2.3304 => 2.6957, std.dev.: 0.1143)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.17% (4.6576 => 5.3175, std.dev.: 0.0131)
  MultiSource/Applications/sgefa/sgefa: 14.00% (1.4030 => 1.5994, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.53% (4.9231 => 5.4908, std.dev.: 0.0408)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.87% (7.0762 => 7.8451, std.dev.: 0.0157)
  SingleSource/Benchmarks/Shootout/ary3: 10.75% (5.8158 => 6.4409, std.dev.: 0.0181)
  SingleSource/Benchmarks/Linpack/linpack-pc: 9.14% (48.3256 => 52.7418, std.dev.: 0.2179)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.37% (2.9467 => 3.1934, std.dev.: 0.0307)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.37% (1.2557 => 1.3608, std.dev.: 0.0231)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.31% (5.4910 => 5.9474, std.dev.: 0.0605)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.28% (3.7593 => 3.9954, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.80% (3.3464 => 3.5404, std.dev.: 0.0554)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.48% (5.5008 => 5.8025, std.dev.: 0.0460)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 4.78% (1.4398 => 1.5086, std.dev.: 0.0059)
  MultiSource/Applications/siod/siod: 4.40% (3.3761 => 3.5248, std.dev.: 0.0515)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.30% (5.1471 => 5.3685, std.dev.: 0.0207)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.36% (25.0200 => 25.8606, std.dev.: 0.0622)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 3.19% (1.5956 => 1.6465, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.13% (4.8739 => 5.0263, std.dev.: 0.0121)
  MultiSource/Applications/spiff/spiff: 2.59% (2.7609 => 2.8325, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.49% (12.8625 => 13.1832, std.dev.: 0.0281)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.75% (0.2237 => 0.1482, std.dev.: 0.0151)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.21% (1.5228 => 1.2150, std.dev.: 0.0472)
  MultiSource/Applications/lua/lua: -16.76% (5.3200 => 4.4283, std.dev.: 0.1012)
  MultiSource/Applications/sgefa/sgefa: -15.97% (0.4809 => 0.4041, std.dev.: 0.0028)
  MultiSource/Applications/hexxagon/hexxagon: -14.60% (1.3285 => 1.1346, std.dev.: 0.0727)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.71% (1.3985 => 1.2207, std.dev.: 0.0358)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.84% (0.1870 => 0.1686, std.dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.49% (0.3073 => 0.2812, std.dev.: 0.0043)
  MultiSource/Applications/siod/siod: -6.61% (2.7150 => 2.5355, std.dev.: 0.0605)
  MultiSource/Applications/oggenc/oggenc: -3.75% (6.1121 => 5.8830, std.dev.: 0.0790)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.05% (5.2851 => 5.1768, std.dev.: 0.0256)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -37.06% (1.4194 => 0.8933, std.dev.: 0.1254)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.87% (2.1022 => 1.4322, std.dev.: 0.1483)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -31.13% (0.0816 => 0.0562, std.dev.: 0.0009)
  MultiSource/Applications/viterbi/viterbi: -26.19% (3.4923 => 2.5777, std.dev.: 0.0098)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6171, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -15.66% (5.3098 => 4.4785, std.dev.: 0.0135)
  SingleSource/Benchmarks/Misc/mandel: -14.85% (1.1996 => 1.0215, std.dev.: 0.0069)
  SingleSource/Benchmarks/Shootout-C++/matrix: -11.82% (2.8867 => 2.5456, std.dev.: 0.0513)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -11.06% (2.6992 => 2.4007, std.dev.: 0.0426)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.34% (0.5173 => 0.4690, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/fp-convert: -7.49% (8.0730 => 7.4684, std.dev.: 0.0819)
  MultiSource/Applications/lua/lua: -6.68% (31.0707 => 28.9952, std.dev.: 0.7931)
  SingleSource/Regression/C/uint64_to_float: -5.11% (1.5184 => 1.4408, std.dev.: 0.0206)
  SingleSource/Benchmarks/Shootout/matrix: -4.93% (1.7358 => 1.6503, std.dev.: 0.0222)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.26% (0.7355 => 0.7042, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.21% (3.8119 => 3.6513, std.dev.: 0.0368)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.18% (1.1024 => 1.0563, std.dev.: 0.0068)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.90% (1.1032 => 1.0602, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.44% (6.0444 => 5.8362, std.dev.: 0.0565)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.21% (21.6864 => 20.9910, std.dev.: 0.1613)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.11% (5.0417 => 4.8848, std.dev.: 0.0327)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.69% (0.7806 => 0.7596, std.dev.: 0.0007)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.38% (2.7049 => 2.6404, std.dev.: 0.0162)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.31% (47.2250 => 46.1354, std.dev.: 0.1612)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.03% (3.5516 => 3.4795, std.dev.: 0.0097)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.99% (34.8438 => 34.1509, std.dev.: 0.2305)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.97% (3.0087 => 2.9493, std.dev.: 0.0222)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.20% (2.1343 => 2.1086, std.dev.: 0.0013)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.47% (0.1378 => 0.1344, std.dev.: 0.0025)

Report Time: 1.10s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130827/92a2f5ba/attachment.html>


More information about the llvm-testresults mailing list