[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Sep 25 22:43:19 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15677?compare_to=15673&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15677, Order: 191416, Start Time: 2013-09-26 03:58:56, End Time: 2013-09-26 05:46:06
      To: 15673, Order: 191415, Start Time: 2013-09-26 01:47:43, End Time: 2013-09-26 03:29:15
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 21 (46 on baseline)
Performance Improvements: 4 (14 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1082 (1047 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/spiff/spiff: 3.66% (0.8901 => 0.9227, std.dev.: 0.0081)
  MultiSource/Benchmarks/McCat/18-imp/imp: 2.71% (0.3878 => 0.3983, std.dev.: 0.0013)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.11% (0.4730 => 0.4830, std.dev.: 0.0031)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 29.81% (3.0378 => 3.9434, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout/matrix: 18.15% (1.7879 => 2.1124, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/moments: 8.80% (0.1170 => 0.1273, std.dev.: 0.0012)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.58% (1.2566 => 1.3519, std.dev.: 0.0007)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.47% (0.4391 => 0.4631, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.87% (0.3782 => 0.3966, std.dev.: 0.0024)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.31% (1.0249 => 1.0691, std.dev.: 0.0002)
  SingleSource/Benchmarks/Linpack/linpack-pc: 3.96% (45.2442 => 47.0339, std.dev.: 0.0918)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.08% (3.5695 => 3.6794, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.36% (3.1463 => 3.2206, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/flops: 2.14% (9.3641 => 9.5642, std.dev.: 0.0171)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.06% (1.7774 => 1.8141, std.dev.: 0.0106)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.92% (1.6096 => 1.6405, std.dev.: 0.0012)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.67% (2.3831 => 2.4229, std.dev.: 0.0097)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.58% (3.5625 => 3.6189, std.dev.: 0.0108)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (2.5068 => 2.5424, std.dev.: 0.0019)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.37% (1.2801 => 1.2977, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.26% (2.5210 => 2.5528, std.dev.: 0.0041)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.96% (1.1116 => 1.0898, std.dev.: 0.0046)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -7.46% (0.4573 => 0.4232, std.dev.: 0.0095)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.47% (35.6142 => 35.0911, std.dev.: 0.1995)
  MultiSource/Benchmarks/Olden/tsp/tsp: -1.27% (1.5754 => 1.5554, std.dev.: 0.0022)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.15% (0.1350 => 0.1348, std.dev.: 0.0022)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.46% (0.4624 => 0.4830, std.dev.: 0.0031)
  MultiSource/Applications/spiff/spiff: 3.55% (0.8911 => 0.9227, std.dev.: 0.0081)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.12% (0.8014 => 0.8264, std.dev.: 0.0020)
  MultiSource/Applications/lemon/lemon: 2.81% (1.1862 => 1.2195, std.dev.: 0.0009)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.74% (0.5185 => 0.5327, std.dev.: 0.0038)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.61% (1.2728 => 1.3060, std.dev.: 0.0042)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.47% (1.5333 => 1.5711, std.dev.: 0.0031)
  MultiSource/Applications/kimwitu++/kc: 2.42% (18.3608 => 18.8051, std.dev.: 0.0221)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.34% (1.1393 => 1.1660, std.dev.: 0.0009)
  MultiSource/Applications/JM/lencod/lencod: 2.27% (16.5902 => 16.9674, std.dev.: 0.0471)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.12% (4.5883 => 4.6858, std.dev.: 0.0263)
  MultiSource/Applications/sqlite3/sqlite3: 2.09% (16.2888 => 16.6291, std.dev.: 0.1163)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.99% (5.5014 => 5.6107, std.dev.: 0.0137)
  MultiSource/Applications/JM/ldecod/ldecod: 1.78% (7.4026 => 7.5345, std.dev.: 0.0101)
  MultiSource/Applications/ClamAV/clamscan: 1.64% (16.5398 => 16.8117, std.dev.: 0.0808)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.32% (1.0756 => 1.0898, std.dev.: 0.0046)
  MultiSource/Applications/lua/lua: 1.18% (4.2242 => 4.2740, std.dev.: 0.0091)
  MultiSource/Applications/oggenc/oggenc: 1.15% (5.3339 => 5.3955, std.dev.: 0.0190)
  MultiSource/Applications/hexxagon/hexxagon: 1.11% (1.0276 => 1.0390, std.dev.: 0.0035)
  MultiSource/Applications/hbd/hbd: 1.03% (1.5696 => 1.5857, std.dev.: 0.0013)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.05% (7.6426 => 12.4615, std.dev.: 0.0775)
  SingleSource/Benchmarks/Shootout-C++/matrix: 38.10% (2.8554 => 3.9434, std.dev.: 0.0028)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.63% (0.1374 => 0.1630, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout/matrix: 18.61% (1.7809 => 2.1124, std.dev.: 0.0013)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.35% (1.1013 => 1.2153, std.dev.: 0.0015)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.01% (1.2516 => 1.3519, std.dev.: 0.0007)
  MultiSource/Applications/hexxagon/hexxagon: 6.65% (14.7810 => 15.7633, std.dev.: 0.0041)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0076)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.13% (8.1346 => 8.6334, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.67% (0.1871 => 0.1977, std.dev.: 0.0012)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.14% (0.8273 => 0.8698, std.dev.: 0.0128)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.39% (0.3836 => 0.3966, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.35% (6.5990 => 6.8200, std.dev.: 0.0471)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.92% (1.5940 => 1.6405, std.dev.: 0.0012)
  MultiSource/Applications/siod/siod: 2.88% (3.5310 => 3.6326, std.dev.: 0.0035)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.77% (1.7652 => 1.8141, std.dev.: 0.0106)
  MultiSource/Benchmarks/Olden/power/power: 2.42% (1.2170 => 1.2464, std.dev.: 0.0009)
  MultiSource/Applications/sqlite3/sqlite3: 2.03% (4.2733 => 4.3599, std.dev.: 0.0034)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (2.4920 => 2.5424, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.02% (3.1569 => 3.2206, std.dev.: 0.0044)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (1.6707 => 1.6950, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.45% (5.3022 => 5.3790, std.dev.: 0.0145)
  SingleSource/Benchmarks/Misc/flops: 1.28% (9.4433 => 9.5642, std.dev.: 0.0171)
  MultiSource/Applications/minisat/minisat: 1.26% (6.2760 => 6.3550, std.dev.: 0.0258)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.10% (16.7972 => 16.9821, std.dev.: 0.0588)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.07% (3.7874 => 3.8280, std.dev.: 0.0015)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.66% (0.2571 => 0.2374, std.dev.: 0.0033)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.34% (0.5226 => 0.2334, std.dev.: 0.0025)
  MultiSource/Applications/sgefa/sgefa: -46.71% (1.5790 => 0.8414, std.dev.: 0.0439)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.11% (15.9508 => 12.7430, std.dev.: 0.5131)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.82% (57.2347 => 47.0339, std.dev.: 0.0918)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.91% (20.8247 => 18.5525, std.dev.: 0.0695)
  MultiSource/Benchmarks/FreeBench/mason/mason: -10.71% (0.3304 => 0.2950, std.dev.: 0.0015)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.23% (3.4956 => 3.1381, std.dev.: 0.0375)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.37% (50.0284 => 46.8413, std.dev.: 0.1534)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.25% (30.1838 => 28.5981, std.dev.: 0.5905)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.33% (3.7437 => 3.6189, std.dev.: 0.0108)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.23% (2.5938 => 2.5101, std.dev.: 0.0151)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.71% (4.3592 => 4.2410, std.dev.: 0.0402)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.63% (17.1431 => 16.6914, std.dev.: 0.0939)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: - (0.1348 => 0.1348, std.dev.: 0.0022)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130926/4536f958/attachment.html>


More information about the llvm-testresults mailing list