[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Oct 4 20:43:08 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15984?compare_to=15981&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15984, Order: 192017, Start Time: 2013-10-05 01:55:06, End Time: 2013-10-05 03:46:06
      To: 15981, Order: 191994, Start Time: 2013-10-04 23:38:58, End Time: 2013-10-05 01:33:43
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 19 (29 on baseline)
Performance Improvements: 29 (14 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1059 (1064 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/aha/aha: 41.67% (0.1399 => 0.1982, std.dev.: 0.0221)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 36.89% (0.1060 => 0.1451, std.dev.: 0.0145)
  MultiSource/Applications/JM/ldecod/ldecod: 23.38% (7.5884 => 9.3622, std.dev.: 0.2938)
  MultiSource/Benchmarks/McCat/05-eks/eks: 21.05% (0.5567 => 0.6739, std.dev.: 0.0171)
  MultiSource/Applications/SPASS/SPASS: 13.04% (17.3400 => 19.6006, std.dev.: 0.8698)
  MultiSource/Applications/JM/lencod/lencod: 10.11% (18.6978 => 20.5874, std.dev.: 0.4636)
  MultiSource/Applications/kimwitu++/kc: 4.81% (19.7556 => 20.7065, std.dev.: 0.3347)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21.19% (2.5606 => 3.1031, std.dev.: 0.0475)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.28% (1.3272 => 1.5566, std.dev.: 0.0366)
  SingleSource/Regression/C/uint64_to_float: 6.62% (1.3867 => 1.4785, std.dev.: 0.0031)
  SingleSource/Benchmarks/Stanford/Puzzle: 6.31% (0.1759 => 0.1870, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.20% (3.5385 => 3.7226, std.dev.: 0.0268)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.46% (4.8378 => 5.0050, std.dev.: 0.0527)
  MultiSource/Benchmarks/Olden/em3d/em3d: 3.06% (5.0386 => 5.1930, std.dev.: 0.0412)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.28% (3.8904 => 3.9792, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.91% (5.8975 => 6.0103, std.dev.: 0.0175)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.14% (18.4328 => 18.6427, std.dev.: 0.0657)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.05% (3.8804 => 3.9210, std.dev.: 0.0069)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.01% (12.4942 => 12.6200, std.dev.: 0.0065)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/build: -44.41% (0.0313 => 0.0174, std.dev.: 0.0011)
  SingleSource/UnitTests/Vector/constpool: -31.75% (12.8691 => 8.7837, std.dev.: 0.3330)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -24.76% (1.9272 => 1.4500, std.dev.: 0.1368)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -21.17% (0.7279 => 0.5738, std.dev.: 0.0132)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -18.12% (0.2561 => 0.2097, std.dev.: 0.0118)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -17.36% (0.4154 => 0.3433, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc/ffbench: -16.81% (0.0958 => 0.0797, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -14.07% (0.0874 => 0.0751, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/ReedSolomon: -13.85% (0.2563 => 0.2208, std.dev.: 0.0133)
  SingleSource/UnitTests/Vector/Altivec/casts: -11.79% (0.1315 => 0.1160, std.dev.: 0.0009)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -10.60% (0.9914 => 0.8863, std.dev.: 0.0130)
  SingleSource/Benchmarks/Shootout-C++/hash2: -10.21% (0.4848 => 0.4353, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/ary: -9.67% (0.2772 => 0.2504, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.03% (0.7100 => 0.6459, std.dev.: 0.0144)
  SingleSource/Benchmarks/Shootout-C++/lists1: -7.66% (0.3379 => 0.3120, std.dev.: 0.0002)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -7.36% (0.5720 => 0.5299, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout-C++/hello: -7.08% (0.1935 => 0.1798, std.dev.: 0.0014)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.47% (0.1978 => 0.1850, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.22% (0.2250 => 0.2110, std.dev.: 0.0044)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.27% (2.8762 => 2.7246, std.dev.: 0.0551)
  SingleSource/Benchmarks/Shootout-C++/methcall: -5.15% (0.2156 => 0.2045, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.67% (1.3525 => 1.2893, std.dev.: 0.0188)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: -37.25% (4.7283 => 2.9668, std.dev.: 0.3661)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -17.14% (34.4629 => 28.5552, std.dev.: 1.0098)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -12.55% (2.4144 => 2.1113, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/lists1: -9.37% (0.6454 => 0.5849, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.28% (5.8989 => 5.7053, std.dev.: 0.0641)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -2.27% (9.6726 => 9.4526, std.dev.: 0.0728)
  SingleSource/Benchmarks/Misc/flops-1: -1.40% (2.3195 => 2.2870, std.dev.: 0.0039)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.61% (0.1418 => 0.1381, std.dev.: 0.0050)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/aha/aha: 54.96% (0.1279 => 0.1982, std.dev.: 0.0221)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 41.70% (0.1024 => 0.1451, std.dev.: 0.0145)
  MultiSource/Benchmarks/Olden/em3d/em3d: 40.77% (0.1972 => 0.2776, std.dev.: 0.0259)
  MultiSource/Benchmarks/McCat/05-eks/eks: 29.97% (0.5185 => 0.6739, std.dev.: 0.0171)
  MultiSource/Applications/JM/ldecod/ldecod: 26.47% (7.4026 => 9.3622, std.dev.: 0.2938)
  MultiSource/Applications/JM/lencod/lencod: 24.09% (16.5902 => 20.5874, std.dev.: 0.4636)
  MultiSource/Applications/SPASS/SPASS: 21.26% (16.1646 => 19.6006, std.dev.: 0.8698)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.95% (4.9293 => 5.8633, std.dev.: 0.2474)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.89% (1.6465 => 1.8917, std.dev.: 0.0893)
  MultiSource/Applications/kimwitu++/kc: 12.78% (18.3608 => 20.7065, std.dev.: 0.3347)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.44% (1.0952 => 1.1548, std.dev.: 0.0162)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.47% (9.9903 => 10.2367, std.dev.: 0.0681)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 65.13% (7.6426 => 12.6200, std.dev.: 0.0065)
  MultiSource/Benchmarks/Olden/mst/mst: 55.12% (0.1377 => 0.2136, std.dev.: 0.0290)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 25.36% (2.4753 => 3.1031, std.dev.: 0.0475)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.66% (1.3008 => 1.5566, std.dev.: 0.0366)
  MultiSource/Applications/SPASS/SPASS: 15.00% (8.2311 => 9.4656, std.dev.: 0.4754)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.53% (0.8273 => 0.8896, std.dev.: 0.0169)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.80% (8.1346 => 8.6877, std.dev.: 0.0260)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.44% (3.5642 => 3.7226, std.dev.: 0.0268)
  MultiSource/Applications/spiff/spiff: 4.16% (2.8194 => 2.9367, std.dev.: 0.0304)
  MultiSource/Benchmarks/Olden/em3d/em3d: 3.27% (5.0288 => 5.1930, std.dev.: 0.0412)
  MultiSource/Applications/hexxagon/hexxagon: 2.57% (14.7810 => 15.1603, std.dev.: 0.0359)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.18% (0.5182 => 0.5295, std.dev.: 0.0009)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.83% (16.7972 => 17.1042, std.dev.: 0.0221)
  SingleSource/Regression/C/uint64_to_float: 1.77% (1.4528 => 1.4785, std.dev.: 0.0031)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.63% (3.8582 => 3.9210, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.35% (5.4925 => 5.5664, std.dev.: 0.0282)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.78% (0.1483 => 0.1160, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.42% (0.1956 => 0.1850, std.dev.: 0.0006)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.29% (0.5226 => 0.2389, std.dev.: 0.0170)
  MultiSource/Applications/sgefa/sgefa: -46.78% (1.5790 => 0.8404, std.dev.: 0.0347)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.05% (15.9508 => 13.2317, std.dev.: 0.8181)
  MultiSource/Benchmarks/FreeBench/mason/mason: -11.56% (0.3304 => 0.2922, std.dev.: 0.0028)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.48% (20.8247 => 18.6427, std.dev.: 0.0657)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.93% (3.4956 => 3.1486, std.dev.: 0.0296)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.27% (50.0284 => 46.3927, std.dev.: 0.3719)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.13% (4.3592 => 4.1791, std.dev.: 0.0619)
  MultiSource/Applications/JM/lencod/lencod: -3.69% (8.1785 => 7.8768, std.dev.: 0.0746)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.01% (17.1431 => 16.6272, std.dev.: 0.0882)
  SingleSource/Benchmarks/Shootout-C++/lists1: -1.73% (0.5952 => 0.5849, std.dev.: 0.0030)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.17% (89.7126 => 88.6614, std.dev.: 0.0492)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.45% (0.1348 => 0.1381, std.dev.: 0.0050)

Report Time: 1.34s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131004/12476f7e/attachment.html>


More information about the llvm-testresults mailing list