[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Oct 6 22:02:08 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16054?compare_to=16051&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16054, Order: 192079, Start Time: 2013-10-07 03:20:40, End Time: 2013-10-07 05:05:08
      To: 16051, Order: 192078, Start Time: 2013-10-07 01:15:46, End Time: 2013-10-07 02:59:34
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 22 (43 on baseline)
Performance Improvements: 2 (24 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1083 (1040 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.43% (0.3319 => 0.3433, std.dev.: 0.0007)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.34% (0.5545 => 0.5675, std.dev.: 0.0032)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.22% (1.5510 => 1.5699, std.dev.: 0.0050)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 35.63% (2.9105 => 3.9475, std.dev.: 0.0011)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.70% (0.4145 => 0.4630, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/ReedSolomon: 11.28% (8.8178 => 9.8121, std.dev.: 0.0032)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.17% (1.1019 => 1.2140, std.dev.: 0.0041)
  SingleSource/Benchmarks/Stanford/Puzzle: 6.61% (0.1755 => 0.1871, std.dev.: 0.0001)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.64% (0.6903 => 0.7292)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 5.37% (0.4597 => 0.4844, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/pi: 4.51% (2.4981 => 2.6108, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc/fp-convert: 3.89% (7.5502 => 7.8442, std.dev.: 0.0155)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 3.34% (1.4422 => 1.4904, std.dev.: 0.0010)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.58% (5.5219 => 5.6646, std.dev.: 0.0258)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.23% (6.7552 => 6.9060, std.dev.: 0.0374)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.82% (6.6991 => 6.8211, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout/hash: 1.52% (5.0461 => 5.1228, std.dev.: 0.0163)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.46% (4.4783 => 4.5437, std.dev.: 0.0165)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.34% (5.8091 => 5.8871, std.dev.: 0.0131)
  SingleSource/Benchmarks/Shootout/sieve: 1.30% (8.3834 => 8.4925, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.28% (12.4960 => 12.6563, std.dev.: 0.0440)
  SingleSource/Benchmarks/Shootout/lists: 1.19% (7.4174 => 7.5056, std.dev.: 0.0063)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/recursive: -1.54% (2.3332 => 2.2973, std.dev.: 0.0109)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.38% (1.0828 => 1.0679, std.dev.: 0.0042)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 5.47% (0.1279 => 0.1349, std.dev.: 0.0251)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: 14.48% (0.2949 => 0.3376, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.70% (0.4624 => 0.4795, std.dev.: 0.0009)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.81% (2.6492 => 2.7237, std.dev.: 0.0112)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.74% (4.0397 => 4.1503, std.dev.: 0.0264)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.39% (1.5333 => 1.5699, std.dev.: 0.0050)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.19% (1.2728 => 1.3007, std.dev.: 0.0096)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.8802 => 0.8962, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.78% (0.6297 => 0.6409, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.74% (6.0284 => 6.1333, std.dev.: 0.0142)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.64% (0.8667 => 0.8809, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C/football/football: 1.63% (0.9828 => 0.9988, std.dev.: 0.0061)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 65.60% (7.6426 => 12.6563, std.dev.: 0.0440)
  SingleSource/Benchmarks/Misc/pi: 57.52% (1.6574 => 2.6108, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/matrix: 38.25% (2.8554 => 3.9475, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout/matrix: 18.59% (1.7809 => 2.1120, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout/sieve: 17.54% (7.2254 => 8.4925, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/ReedSolomon: 15.09% (8.5256 => 9.8121, std.dev.: 0.0032)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.23% (1.1013 => 1.2140, std.dev.: 0.0041)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.17% (1.2516 => 1.3539, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.77% (0.8273 => 0.8833, std.dev.: 0.0188)
  SingleSource/UnitTests/Vector/multiplies: 6.62% (0.5561 => 0.5929, std.dev.: 0.0000)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.31% (8.1346 => 8.6476, std.dev.: 0.0196)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.45% (5.3716 => 5.6646, std.dev.: 0.0258)
  SingleSource/Benchmarks/McGill/misr: 5.09% (0.3771 => 0.3963, std.dev.: 0.0000)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.65% (6.5990 => 6.9060, std.dev.: 0.0374)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.22% (0.3836 => 0.3998, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.73% (0.2842 => 0.2948, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/fp-convert: 3.38% (7.5877 => 7.8442, std.dev.: 0.0155)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.33% (2.3084 => 2.3853, std.dev.: 0.0135)
  MultiSource/Applications/siod/siod: 2.80% (3.5310 => 3.6298, std.dev.: 0.0221)
  MultiSource/Benchmarks/Olden/power/power: 2.41% (1.2170 => 1.2463, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.32% (3.5683 => 3.6511, std.dev.: 0.0062)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (1.7652 => 1.8055, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.03% (3.1569 => 3.2211, std.dev.: 0.0012)
  SingleSource/Regression/C/uint64_to_float: 1.98% (1.4528 => 1.4815, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout/lists: 1.84% (7.3703 => 7.5056, std.dev.: 0.0063)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.77% (3.8582 => 3.9264, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.67% (1.0477 => 1.0652, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout/fib2: 1.65% (3.5966 => 3.6559, std.dev.: 0.0003)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.26% (16.7972 => 17.0083, std.dev.: 0.0571)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.16% (6.7429 => 6.8211, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout/methcall: 1.12% (8.5434 => 8.6395, std.dev.: 0.0247)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (3.7874 => 3.8287, std.dev.: 0.0004)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.57% (0.1483 => 0.1178, std.dev.: 0.0010)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.04% (0.1195 => 0.1087, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.39% (0.2571 => 0.2381, std.dev.: 0.0017)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.52% (0.1956 => 0.1848, std.dev.: 0.0018)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.13% (0.5226 => 0.2345, std.dev.: 0.0036)
  MultiSource/Applications/sgefa/sgefa: -47.08% (1.5790 => 0.8356, std.dev.: 0.0347)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -37.00% (0.0400 => 0.0252, std.dev.: 0.0051)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.16% (15.9508 => 12.8954, std.dev.: 0.2123)
  SingleSource/Benchmarks/Shootout/heapsort: -18.07% (3.5900 => 2.9414, std.dev.: 0.2208)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -16.32% (1.7197 => 1.4391, std.dev.: 0.0825)
  SingleSource/Benchmarks/Linpack/linpack-pc: -10.94% (57.2347 => 50.9704, std.dev.: 1.4295)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.92% (20.8247 => 18.7585, std.dev.: 0.0829)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.00% (3.4956 => 3.2161, std.dev.: 0.0003)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.33% (50.0284 => 46.3616, std.dev.: 0.4080)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.90% (30.1838 => 28.4043, std.dev.: 0.3461)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.03% (0.7474 => 0.7098, std.dev.: 0.0045)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.90% (4.3592 => 4.1893, std.dev.: 0.0603)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.58% (1.1075 => 1.0679, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.32% (17.1431 => 16.7446, std.dev.: 0.0564)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.29% (6.1088 => 5.9689, std.dev.: 0.0012)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.95% (2.5938 => 2.5432, std.dev.: 0.0006)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -1.68% (2.3365 => 2.2973, std.dev.: 0.0109)
  SingleSource/Benchmarks/Shootout/hash: -1.50% (5.2009 => 5.1228, std.dev.: 0.0163)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.05% (2.4471 => 2.4213, std.dev.: 0.0014)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1348 => 0.1349, std.dev.: 0.0251)

Report Time: 0.96s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131007/04fbdb21/attachment.html>


More information about the llvm-testresults mailing list