[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Nov 1 22:30:23 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16919?compare_to=16915&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16919, Order: 193908, Start Time: 2013-11-02 03:48:36, End Time: 2013-11-02 05:33:54
      To: 16915, Order: 193902, Start Time: 2013-11-02 01:37:12, End Time: 2013-11-02 03:25:34
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 23 (58 on baseline)
Performance Improvements: 15 (32 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1069 (1017 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.62% (1.3718 => 1.4901, std.dev.: 0.0415)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.34% (6.8208 => 7.3895, std.dev.: 0.1884)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.69% (3.6052 => 3.8465, std.dev.: 0.0086)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.97% (1.0942 => 1.1595, std.dev.: 0.0088)
  SingleSource/Regression/C/uint64_to_float: 5.76% (1.4018 => 1.4825, std.dev.: 0.0030)
  SingleSource/Benchmarks/McGill/misr: 4.37% (0.3981 => 0.4155, std.dev.: 0.0001)
  MultiSource/Applications/hexxagon/hexxagon: 3.72% (15.0930 => 15.6545, std.dev.: 0.0611)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.19% (2.4712 => 2.5500, std.dev.: 0.0130)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.69% (1.8454 => 1.8951, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.63% (5.0777 => 5.2112, std.dev.: 0.0219)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 2.55% (3.9644 => 4.0654, std.dev.: 0.0314)
  MultiSource/Applications/lua/lua: 2.05% (29.2936 => 29.8937, std.dev.: 0.1310)
  MultiSource/Applications/siod/siod: 2.04% (3.4783 => 3.5493, std.dev.: 0.0109)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.04% (3.2271 => 3.2928, std.dev.: 0.0140)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.74% (3.6031 => 3.6658, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.61% (3.9656 => 4.0293, std.dev.: 0.0136)
  MultiSource/Benchmarks/llubenchmark/llu: 1.60% (1.9648 => 1.9963, std.dev.: 0.0111)
  MultiSource/Applications/spiff/spiff: 1.55% (2.9371 => 2.9825, std.dev.: 0.0060)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.46% (3.5979 => 3.6504, std.dev.: 0.0185)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.39% (15.9055 => 16.1261, std.dev.: 0.0242)
  MultiSource/Applications/sgefa/sgefa: 1.21% (0.9028 => 0.9137, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout/fib2: 1.18% (3.6087 => 3.6514, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.11% (5.9194 => 5.9850, std.dev.: 0.0137)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -6.10% (0.2146 => 0.2015, std.dev.: 0.0022)
  MultiSource/Applications/sgefa/sgefa: -3.14% (0.4045 => 0.3918, std.dev.: 0.0019)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.74% (0.9707 => 0.9441, std.dev.: 0.0093)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.79% (1.5658 => 1.5378, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.76% (1.2572 => 1.2351, std.dev.: 0.0045)
  MultiSource/Applications/Burg/burg: -1.51% (1.4544 => 1.4325, std.dev.: 0.0029)
  MultiSource/Applications/treecc/treecc: -1.29% (2.3106 => 2.2808, std.dev.: 0.0058)
  MultiSource/Applications/spiff/spiff: -1.26% (0.9200 => 0.9084, std.dev.: 0.0030)
  MultiSource/Applications/siod/siod: -1.02% (2.5552 => 2.5292, std.dev.: 0.0083)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -11.44% (24.2551 => 21.4809, std.dev.: 0.4643)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.88% (6.9620 => 6.6922, std.dev.: 0.0714)
  SingleSource/Benchmarks/Linpack/linpack-pc: -2.44% (49.8877 => 48.6710, std.dev.: 0.1394)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.96% (7.0861 => 6.9474, std.dev.: 0.0325)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.86% (1.3108 => 1.2864, std.dev.: 0.0076)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (7.6946 => 7.6054, std.dev.: 0.0030)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.51% (0.1370 => 0.1377, std.dev.: 0.0036)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/oourafft: 9.72% (0.2294 => 0.2517, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.62% (1.6047 => 1.7431, std.dev.: 0.0289)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.82% (4.0397 => 4.3154, std.dev.: 0.0602)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.71% (0.2949 => 0.3147, std.dev.: 0.0074)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.82% (2.6492 => 2.7770, std.dev.: 0.0114)
  MultiSource/Applications/JM/lencod/lencod: 4.71% (16.5902 => 17.3710, std.dev.: 0.0349)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.17% (0.4624 => 0.4817, std.dev.: 0.0044)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.3096 => 0.3221, std.dev.: 0.0015)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.97% (1.1393 => 1.1845, std.dev.: 0.0110)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.58% (0.8014 => 0.8301, std.dev.: 0.0038)
  MultiSource/Applications/oggenc/oggenc: 3.56% (5.3339 => 5.5236, std.dev.: 0.0220)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 3.39% (1.2728 => 1.3160, std.dev.: 0.0155)
  MultiSource/Applications/siod/siod: 3.32% (2.4480 => 2.5292, std.dev.: 0.0083)
  MultiSource/Applications/JM/ldecod/ldecod: 3.10% (7.4026 => 7.6318, std.dev.: 0.0336)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.45% (0.6439 => 0.6597, std.dev.: 0.0038)
  MultiSource/Applications/ClamAV/clamscan: 2.41% (16.5398 => 16.9379, std.dev.: 0.0303)
  MultiSource/Applications/Burg/burg: 2.37% (1.3994 => 1.4325, std.dev.: 0.0029)
  MultiSource/Applications/minisat/minisat: 2.22% (0.7439 => 0.7604, std.dev.: 0.0033)
  MultiSource/Applications/d/make_dparser: 2.21% (3.4962 => 3.5733, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.99% (0.8802 => 0.8977, std.dev.: 0.0019)
  MultiSource/Applications/spiff/spiff: 1.94% (0.8911 => 0.9084, std.dev.: 0.0030)
  MultiSource/Applications/hbd/hbd: 1.58% (1.5696 => 1.5944, std.dev.: 0.0044)
  MultiSource/Applications/hexxagon/hexxagon: 1.40% (1.0276 => 1.0420, std.dev.: 0.0013)
  MultiSource/Applications/treecc/treecc: 1.30% (2.2516 => 2.2808, std.dev.: 0.0058)
  MultiSource/Applications/SPASS/SPASS: 1.07% (16.1646 => 16.3369, std.dev.: 0.0605)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 61.93% (7.6426 => 12.3756, std.dev.: 0.0411)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 55.44% (4.4696 => 6.9474, std.dev.: 0.0325)
  SingleSource/Benchmarks/Shootout-C++/matrix: 50.31% (2.8554 => 4.2919, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 37.97% (4.2391 => 5.8487, std.dev.: 0.1629)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 30.36% (1.1431 => 1.4901, std.dev.: 0.0415)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.70% (6.4425 => 7.3895, std.dev.: 0.1884)
  SingleSource/Benchmarks/Shootout/matrix: 10.66% (1.7809 => 1.9707, std.dev.: 0.0667)
  SingleSource/Benchmarks/McGill/misr: 10.18% (0.3771 => 0.4155, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.64% (0.1331 => 0.1446, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.20% (3.5550 => 3.8465, std.dev.: 0.0086)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.09% (1.2516 => 1.3528, std.dev.: 0.0244)
  MultiSource/Applications/oggenc/oggenc: 7.47% (0.1699 => 0.1826, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/multiplies: 6.58% (0.5561 => 0.5927, std.dev.: 0.0000)
  MultiSource/Applications/hexxagon/hexxagon: 5.91% (14.7810 => 15.6545, std.dev.: 0.0611)
  MultiSource/Applications/spiff/spiff: 5.78% (2.8194 => 2.9825, std.dev.: 0.0060)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.63% (3.1730 => 3.3516, std.dev.: 0.0261)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.45% (0.1871 => 0.1973, std.dev.: 0.0012)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.28% (1.1013 => 1.1595, std.dev.: 0.0088)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.49% (0.3836 => 0.3970, std.dev.: 0.0014)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.13% (89.7126 => 92.5234, std.dev.: 0.2449)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.59% (0.6563 => 0.6733, std.dev.: 0.0016)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.44% (0.4549 => 0.4660, std.dev.: 0.0004)
  MultiSource/Applications/sqlite3/sqlite3: 2.37% (4.2733 => 4.3746, std.dev.: 0.0107)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.33% (1.8519 => 1.8951, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.30% (3.5683 => 3.6504, std.dev.: 0.0185)
  MultiSource/Applications/minisat/minisat: 2.22% (6.2760 => 6.4156, std.dev.: 0.0318)
  SingleSource/Regression/C/uint64_to_float: 2.04% (1.4528 => 1.4825, std.dev.: 0.0030)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.03% (1.0477 => 1.0690, std.dev.: 0.0003)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.75% (6.7429 => 6.8606, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout/fib2: 1.52% (3.5966 => 3.6514, std.dev.: 0.0041)
  MultiSource/Applications/lua/lua: 1.27% (29.5202 => 29.8937, std.dev.: 0.1310)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.10% (3.9856 => 4.0293, std.dev.: 0.0136)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (6.1088 => 6.1751, std.dev.: 0.0034)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.57% (0.1483 => 0.1178, std.dev.: 0.0003)
  MultiSource/Benchmarks/FreeBench/distray/distray: -12.31% (0.1194 => 0.1047, std.dev.: 0.0006)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.87% (0.1195 => 0.1077, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.08% (0.2571 => 0.2389, std.dev.: 0.0012)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -52.39% (0.5226 => 0.2488, std.dev.: 0.0172)
  MultiSource/Applications/sgefa/sgefa: -42.13% (1.5790 => 0.9137, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -21.31% (4.0181 => 3.1618, std.dev.: 0.1615)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.43% (15.9508 => 12.8519, std.dev.: 0.5592)
  MultiSource/Benchmarks/FreeBench/mason/mason: -18.13% (0.3304 => 0.2705, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout/heapsort: -17.79% (3.5900 => 2.9514, std.dev.: 0.1952)
  SingleSource/Benchmarks/Shootout-C++/moments: -16.96% (0.1285 => 0.1067, std.dev.: 0.0010)
  SingleSource/Benchmarks/Linpack/linpack-pc: -14.96% (57.2347 => 48.6710, std.dev.: 0.1394)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -14.81% (1.7197 => 1.4650, std.dev.: 0.0650)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -13.94% (20.8247 => 17.9220, std.dev.: 0.3472)
  SingleSource/Benchmarks/Shootout-C++/ary3: -13.86% (5.0002 => 4.3072, std.dev.: 0.1679)
  MultiSource/Applications/SIBsim4/SIBsim4: -12.04% (3.7437 => 3.2928, std.dev.: 0.0140)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.84% (3.4956 => 3.1865, std.dev.: 0.0020)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.51% (8.1346 => 7.6054, std.dev.: 0.0030)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.31% (30.1838 => 28.5797, std.dev.: 0.2519)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.01% (0.7474 => 0.7174, std.dev.: 0.0087)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.47% (0.3462 => 0.3342, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.38% (5.4473 => 5.2632, std.dev.: 0.0710)
  MultiSource/Applications/SPASS/SPASS: -3.38% (8.2311 => 7.9532, std.dev.: 0.0801)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.29% (1.7652 => 1.7071, std.dev.: 0.0194)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.03% (4.3592 => 4.2272, std.dev.: 0.0412)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.88% (2.4471 => 2.3767, std.dev.: 0.0210)
  MultiSource/Benchmarks/Olden/power/power: -2.70% (1.2170 => 1.1842, std.dev.: 0.0007)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.56% (3.7874 => 3.6905, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.32% (2.5938 => 2.5337, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.29% (17.1431 => 16.7511, std.dev.: 0.0283)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.53% (3.8582 => 3.7991, std.dev.: 0.0184)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.24% (1.4898 => 1.4714, std.dev.: 0.0040)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.15% (0.1348 => 0.1377, std.dev.: 0.0036)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131102/41486123/attachment.html>


More information about the llvm-testresults mailing list