[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Oct 17 17:39:57 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16421?compare_to=16418&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16421, Order: 192925, Start Time: 2013-10-17 22:52:57, End Time: 2013-10-18 00:43:08
      To: 16418, Order: 192915, Start Time: 2013-10-17 20:30:52, End Time: 2013-10-17 22:24:09
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 17 (28 on baseline)
Performance Improvements: 34 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1056 (1063 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.56% (1.3723 => 1.5584, std.dev.: 0.0448)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.35% (0.4159 => 0.4631, std.dev.: 0.0002)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 8.16% (0.1826 => 0.1975, std.dev.: 0.0008)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.08% (2.8279 => 3.0564, std.dev.: 0.0410)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.82% (1.4000 => 1.5095, std.dev.: 0.0002)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 6.93% (0.4558 => 0.4874, std.dev.: 0.0091)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.33% (1.0224 => 1.0667, std.dev.: 0.0003)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.63% (2.1358 => 2.2133, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.44% (1.0399 => 1.0653, std.dev.: 0.0002)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.44% (2.4881 => 2.5487, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.31% (2.3192 => 2.3727, std.dev.: 0.0108)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.04% (3.1237 => 3.1873, std.dev.: 0.0091)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.81% (1.8653 => 1.8991, std.dev.: 0.0023)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.61% (2.5187 => 2.5592, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.37% (3.1688 => 3.2121, std.dev.: 0.0050)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.17% (1.7878 => 1.8087, std.dev.: 0.0025)
  MultiSource/Applications/siod/siod: 1.12% (3.5688 => 3.6089, std.dev.: 0.0140)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -30.21% (0.2953 => 0.2061, std.dev.: 0.0333)
  MultiSource/Applications/obsequi/Obsequi: -28.01% (1.6138 => 1.1618, std.dev.: 0.0499)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -24.95% (0.1840 => 0.1381, std.dev.: 0.0001)
  MultiSource/Benchmarks/Olden/tsp/tsp: -24.47% (0.1790 => 0.1352, std.dev.: 0.0010)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -23.44% (0.1361 => 0.1042, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/bisort/bisort: -19.71% (0.0903 => 0.0725, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/methcall: -19.52% (0.2557 => 0.2058, std.dev.: 0.0133)
  MultiSource/Benchmarks/McCat/08-main/main: -19.44% (0.3873 => 0.3120, std.dev.: 0.0104)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -19.31% (0.1253 => 0.1011, std.dev.: 0.0025)
  MultiSource/Applications/oggenc/oggenc: -15.51% (6.4465 => 5.4464, std.dev.: 0.3088)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -13.76% (0.1185 => 0.1022, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.46% (0.1850 => 0.1601, std.dev.: 0.0082)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.50% (0.1823 => 0.1668, std.dev.: 0.0014)
  MultiSource/Benchmarks/McCat/09-vor/vor: -8.45% (0.3955 => 0.3621, std.dev.: 0.0047)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.05% (0.1825 => 0.1678, std.dev.: 0.0008)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -7.60% (8.0394 => 7.4283, std.dev.: 0.0661)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.72% (0.2840 => 0.2706, std.dev.: 0.0036)
  MultiSource/Benchmarks/McCat/05-eks/eks: -4.51% (0.5587 => 0.5335, std.dev.: 0.0021)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: -37.74% (0.0310 => 0.0193, std.dev.: 0.0044)
  MultiSource/Applications/SPASS/SPASS: -37.32% (12.7797 => 8.0104, std.dev.: 1.7451)
  MultiSource/Benchmarks/Olden/bisort/bisort: -30.67% (0.9688 => 0.6717, std.dev.: 0.0061)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -27.36% (0.5862 => 0.4258, std.dev.: 0.0376)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -18.00% (1.5792 => 1.2949, std.dev.: 0.0351)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.06% (46.0078 => 40.9202, std.dev.: 1.9227)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -9.18% (2.9523 => 2.6814, std.dev.: 0.0062)
  MultiSource/Benchmarks/McCat/09-vor/vor: -8.82% (0.1259 => 0.1148, std.dev.: 0.0029)
  MultiSource/Benchmarks/Olden/tsp/tsp: -6.43% (1.6486 => 1.5426, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.55% (6.4481 => 6.0900, std.dev.: 0.0088)
  MultiSource/Benchmarks/FreeBench/distray/distray: -4.86% (0.2450 => 0.2331, std.dev.: 0.0003)
  MultiSource/Applications/lua/lua: -4.41% (30.4931 => 29.1471, std.dev.: 0.2590)
  SingleSource/Benchmarks/Misc/flops-8: -3.51% (2.6176 => 2.5257, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/richards_benchmark: -3.08% (1.4569 => 1.4120, std.dev.: 0.0072)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.61% (0.4790 => 0.4665, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.32% (3.9964 => 3.9436, std.dev.: 0.0147)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: - (0.1366 => 0.1366, std.dev.: 0.0380)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/hello: 16.45% (0.1787 => 0.2081, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 15.45% (1.3499 => 1.5584, std.dev.: 0.0448)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.00% (0.4624 => 0.4855, std.dev.: 0.0018)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.87% (2.6492 => 2.7781, std.dev.: 0.0305)
  MultiSource/Benchmarks/McCat/09-vor/vor: 4.05% (0.3480 => 0.3621, std.dev.: 0.0047)
  MultiSource/Benchmarks/Prolangs-C/football/football: 3.34% (0.9828 => 1.0156, std.dev.: 0.0076)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.5185 => 0.5335, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.04% (9.7354 => 9.9337, std.dev.: 0.0757)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.44% (1.0952 => 1.1110, std.dev.: 0.0036)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.61% (7.6426 => 12.5040, std.dev.: 0.1117)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 32.05% (1.1431 => 1.5095, std.dev.: 0.0002)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.33% (2.4753 => 2.6814, std.dev.: 0.0062)
  SingleSource/UnitTests/Vector/multiplies: 6.53% (0.5561 => 0.5924, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.56% (0.1871 => 0.1975, std.dev.: 0.0008)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.04% (5.3716 => 5.6422, std.dev.: 0.0198)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.45% (89.7126 => 92.8114, std.dev.: 0.0490)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.08% (2.1472 => 2.2133, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.79% (2.3084 => 2.3727, std.dev.: 0.0108)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.55% (1.8519 => 1.8991, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.49% (5.7757 => 5.9195, std.dev.: 0.0186)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.46% (1.7652 => 1.8087, std.dev.: 0.0025)
  MultiSource/Benchmarks/Olden/power/power: 2.40% (1.2170 => 1.2462, std.dev.: 0.0001)
  MultiSource/Applications/siod/siod: 2.21% (3.5310 => 3.6089, std.dev.: 0.0140)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.08% (1.5940 => 1.6272, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.81% (5.4925 => 5.5917, std.dev.: 0.0169)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.75% (3.1569 => 3.2121, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.68% (1.0477 => 1.0653, std.dev.: 0.0002)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.30% (16.7972 => 17.0160, std.dev.: 0.0432)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -19.89% (0.1483 => 0.1188, std.dev.: 0.0073)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.40% (0.5226 => 0.2383, std.dev.: 0.0195)
  MultiSource/Applications/sgefa/sgefa: -41.87% (1.5790 => 0.9178, std.dev.: 0.0039)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.75% (0.0400 => 0.0261, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/em3d/em3d: -29.22% (5.0288 => 3.5595, std.dev.: 0.0017)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.44% (57.2347 => 43.8172, std.dev.: 4.2367)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.09% (15.9508 => 12.9062, std.dev.: 0.5056)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.21% (50.0284 => 40.9202, std.dev.: 1.9227)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.77% (20.8247 => 18.5823, std.dev.: 0.1226)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.93% (0.3304 => 0.2976, std.dev.: 0.0001)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.82% (3.4956 => 3.1873, std.dev.: 0.0091)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.67% (3.7874 => 3.6863, std.dev.: 0.0070)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.59% (4.3592 => 4.2465, std.dev.: 0.0285)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.39% (2.4471 => 2.3887, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.32% (17.1431 => 16.7456, std.dev.: 0.0420)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.74% (2.5938 => 2.5487, std.dev.: 0.0020)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.34% (0.1348 => 0.1366, std.dev.: 0.0380)

Report Time: 1.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131017/1df0945c/attachment.html>


More information about the llvm-testresults mailing list