[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Oct 4 02:50:05 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15955?compare_to=15951&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15955, Order: 191942, Start Time: 2013-10-04 08:08:56, End Time: 2013-10-04 09:53:02
      To: 15951, Order: 191940, Start Time: 2013-10-04 06:00:15, End Time: 2013-10-04 07:47:56
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 25 (49 on baseline)
Performance Improvements: 6 (26 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1076 (1032 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.79% (1.1524 => 1.1730, std.dev.: 0.0077)
  MultiSource/Applications/lua/lua: 1.14% (4.2318 => 4.2802, std.dev.: 0.0113)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 43.95% (1.8138 => 2.6110, std.dev.: 0.0002)
  SingleSource/Benchmarks/Linpack/linpack-pc: 42.68% (33.7722 => 48.1873, std.dev.: 2.4883)
  SingleSource/Benchmarks/Shootout-C++/matrix: 32.68% (2.9767 => 3.9494, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout/matrix: 20.23% (1.7572 => 2.1126, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout/sieve: 19.13% (7.1303 => 8.4946, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/ReedSolomon: 15.56% (8.4923 => 9.8141, std.dev.: 0.0032)
  MultiSource/Applications/JM/lencod/lencod: 9.13% (7.7915 => 8.5029, std.dev.: 0.0197)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.94% (0.3075 => 0.3227, std.dev.: 0.0029)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.41% (0.6940 => 0.7246, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/fp-convert: 4.17% (7.5268 => 7.8404, std.dev.: 0.0195)
  SingleSource/Benchmarks/Shootout/lists: 3.86% (7.2351 => 7.5147, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.97% (5.2495 => 5.4056, std.dev.: 0.0002)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.62% (3.1351 => 3.2173, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.24% (4.5234 => 4.6246, std.dev.: 0.0020)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 2.23% (2.2745 => 2.3252, std.dev.: 0.0133)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 2.09% (23.3245 => 23.8125, std.dev.: 0.0134)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.55% (6.7177 => 6.8217, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout/fib2: 1.48% (3.6010 => 3.6543, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.39% (3.6307 => 3.6811, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.38% (3.1520 => 3.1955, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.10% (4.9374 => 4.9919, std.dev.: 0.0137)
  SingleSource/Benchmarks/Misc/mandel: 1.03% (1.0559 => 1.0668, std.dev.: 0.0000)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.02% (2.5157 => 2.5414, std.dev.: 0.0012)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -14.44% (0.0720 => 0.0616, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.01% (6.1301 => 6.0682, std.dev.: 0.0198)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ackermann: -8.05% (3.7951 => 3.4895, std.dev.: 0.0577)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.43% (2.7228 => 2.6567, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/ffbench: -1.33% (1.4234 => 1.4044, std.dev.: 0.0053)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.29% (4.9037 => 4.8402, std.dev.: 0.0229)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.67% (0.1341 => 0.1350, std.dev.: 0.0398)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: 14.62% (0.2949 => 0.3380, std.dev.: 0.0109)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.99% (4.0397 => 4.1606, std.dev.: 0.0059)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.96% (1.1393 => 1.1730, std.dev.: 0.0077)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.61% (9.9903 => 10.2511, std.dev.: 0.0816)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (1.9476 => 1.9954, std.dev.: 0.0015)
  MultiSource/Applications/Burg/burg: 1.82% (1.3994 => 1.4249, std.dev.: 0.0020)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.81% (0.6297 => 0.6411, std.dev.: 0.0015)
  MultiSource/Applications/treecc/treecc: 1.46% (2.2516 => 2.2844, std.dev.: 0.0049)
  MultiSource/Applications/lua/lua: 1.33% (4.2242 => 4.2802, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.11% (1.2553 => 1.2692, std.dev.: 0.0024)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.70% (7.6426 => 12.5871, std.dev.: 0.0416)
  SingleSource/Benchmarks/Misc/pi: 57.54% (1.6574 => 2.6110, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/matrix: 38.31% (2.8554 => 3.9494, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout/matrix: 18.63% (1.7809 => 2.1126, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout/sieve: 17.57% (7.2254 => 8.4946, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/ReedSolomon: 15.11% (8.5256 => 9.8141, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.35% (6.4425 => 7.2382, std.dev.: 0.0709)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.48% (1.1013 => 1.2167, std.dev.: 0.0105)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.91% (96.7834 => 103.4749, std.dev.: 1.2964)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 6.79% (0.1871 => 0.1998, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.31% (8.1346 => 8.6480, std.dev.: 0.0443)
  MultiSource/Applications/spiff/spiff: 5.66% (2.8194 => 2.9791, std.dev.: 0.0012)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.09% (5.3716 => 5.6452, std.dev.: 0.0495)
  SingleSource/Benchmarks/McGill/misr: 5.09% (0.3771 => 0.3963, std.dev.: 0.0000)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.41% (3.5642 => 3.7213, std.dev.: 0.0021)
  MultiSource/Applications/JM/lencod/lencod: 3.97% (8.1785 => 8.5029, std.dev.: 0.0197)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.87% (0.2842 => 0.2952, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.47% (4.4696 => 4.6246, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.47% (0.3836 => 0.3969, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/fp-convert: 3.33% (7.5877 => 7.8404, std.dev.: 0.0195)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.23% (6.5990 => 6.8123, std.dev.: 0.0793)
  MultiSource/Applications/siod/siod: 2.97% (3.5310 => 3.6357, std.dev.: 0.0063)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.77% (1.7652 => 1.8141, std.dev.: 0.0003)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.34% (0.5182 => 0.5303, std.dev.: 0.0008)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.00% (3.5683 => 3.6396, std.dev.: 0.0079)
  SingleSource/Benchmarks/Shootout/lists: 1.96% (7.3703 => 7.5147, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.95% (5.3022 => 5.4056, std.dev.: 0.0002)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.89% (3.8582 => 3.9313, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.69% (1.0477 => 1.0654, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout/fib2: 1.60% (3.5966 => 3.6543, std.dev.: 0.0020)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.46% (23.4704 => 23.8125, std.dev.: 0.0134)
  SingleSource/Regression/C/uint64_to_float: 1.42% (1.4528 => 1.4734, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.22% (3.1569 => 3.1955, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.20% (6.6028 => 6.6823, std.dev.: 0.0072)
  SingleSource/Benchmarks/Shootout/methcall: 1.20% (8.5434 => 8.6455, std.dev.: 0.0240)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.17% (6.7429 => 6.8217, std.dev.: 0.0003)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (3.7874 => 3.8291, std.dev.: 0.0002)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.10% (16.7972 => 16.9819, std.dev.: 0.0354)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -22.39% (0.1483 => 0.1151, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/matrix: -8.67% (0.2571 => 0.2348, std.dev.: 0.0020)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.21% (0.1956 => 0.1854, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.87% (0.3837 => 0.3727, std.dev.: 0.0038)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.96% (0.5226 => 0.2354, std.dev.: 0.0840)
  MultiSource/Applications/sgefa/sgefa: -46.76% (1.5790 => 0.8406, std.dev.: 0.0004)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.38% (15.9508 => 12.8599, std.dev.: 0.7160)
  SingleSource/Benchmarks/Shootout/heapsort: -17.92% (3.5900 => 2.9467, std.dev.: 0.0486)
  SingleSource/Benchmarks/Linpack/linpack-pc: -15.81% (57.2347 => 48.1873, std.dev.: 2.4883)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -13.47% (1.7197 => 1.4881, std.dev.: 0.0504)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -12.78% (4.0006 => 3.4895, std.dev.: 0.0577)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.34% (20.8247 => 18.6717, std.dev.: 0.0764)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.96% (3.4956 => 3.2173, std.dev.: 0.0007)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.85% (50.0284 => 46.0987, std.dev.: 0.2311)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.29% (30.1838 => 28.5866, std.dev.: 0.0182)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.02% (0.7474 => 0.7099, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/salsa20: -3.69% (7.7964 => 7.5091, std.dev.: 0.0217)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.11% (36.8417 => 35.6953, std.dev.: 0.1217)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.70% (1.1075 => 1.0776, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout/hash: -2.51% (5.2009 => 5.0703, std.dev.: 0.0430)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.46% (4.3592 => 4.2518, std.dev.: 0.0375)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.43% (6.1088 => 5.9602, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.27% (17.1431 => 16.7547, std.dev.: 0.0453)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.02% (2.5938 => 2.5414, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.26% (4.9022 => 4.8402, std.dev.: 0.0229)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.08% (89.7126 => 88.7468, std.dev.: 0.1413)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.15% (0.1348 => 0.1350, std.dev.: 0.0398)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131004/0a71d11b/attachment.html>


More information about the llvm-testresults mailing list