[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jun 3 21:15:15 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12024?compare_to=12021&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12024, Order: 183173, Start Time: 2013-06-04 02:33:16, End Time: 2013-06-04 04:15:55
      To: 12021, Order: 183172, Start Time: 2013-06-04 00:29:31, End Time: 2013-06-04 02:11:12
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 10 (12 on baseline)
Performance Improvements: 5 (80 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1092 (1015 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.64% (0.2179 => 0.2280, std.dev.: 0.0018)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 15.06% (2.0893 => 2.4040, std.dev.: 0.0054)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.68% (2.3214 => 2.5462, std.dev.: 0.0406)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.62% (0.3317 => 0.3636, std.dev.: 0.0029)
  MultiSource/Benchmarks/mafft/pairlocalalign: 6.50% (40.3900 => 43.0156, std.dev.: 0.2084)
  SingleSource/Benchmarks/Misc/ffbench: 4.45% (1.3315 => 1.3908, std.dev.: 0.0089)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 4.34% (2.6014 => 2.7144, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.62% (21.3237 => 21.8825, std.dev.: 0.0886)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (2.5039 => 2.5522, std.dev.: 0.0066)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.32% (37.1449 => 37.6337, std.dev.: 0.0459)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.36% (0.7887 => 0.7780, std.dev.: 0.0007)
  MultiSource/Applications/siod/siod: -1.15% (2.4978 => 2.4690, std.dev.: 0.0054)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -4.51% (0.4856 => 0.4637, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -2.91% (2.6007 => 2.5251, std.dev.: 0.0166)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.30% (5.7032 => 5.5719, std.dev.: 0.0195)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.43% (0.1408 => 0.1414, std.dev.: 0.0025)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.77% (0.2721 => 0.2878, std.dev.: 0.0012)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 31.24% (1.8318 => 2.4040, std.dev.: 0.0054)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 23.75% (0.0459 => 0.0568, std.dev.: 0.0003)
  MultiSource/Applications/sgefa/sgefa: 18.29% (1.1695 => 1.3834, std.dev.: 0.0012)
  SingleSource/Benchmarks/Stanford/Puzzle: 15.40% (0.1455 => 0.1679, std.dev.: 0.0070)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.50% (1.2224 => 1.2896, std.dev.: 0.0203)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.90% (2.5366 => 2.6608, std.dev.: 0.0167)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.08% (1.0571 => 1.1002, std.dev.: 0.0022)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.46% (4.3727 => 4.4801, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.84% (21.4874 => 21.8825, std.dev.: 0.0886)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.43% (3.9713 => 4.0279, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.08% (9.8728 => 9.9790, std.dev.: 0.0217)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -36.12% (0.1113 => 0.0711, std.dev.: 0.0111)
  MultiSource/Applications/viterbi/viterbi: -26.00% (0.2431 => 0.1799, std.dev.: 0.0056)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -17.31% (0.0803 => 0.0664, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc/whetstone: -15.95% (0.1097 => 0.0922, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/constpool: -15.72% (10.3086 => 8.6878, std.dev.: 0.3765)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -12.84% (0.1075 => 0.0937, std.dev.: 0.0006)
  MultiSource/Applications/JM/lencod/lencod: -11.48% (18.9387 => 16.7650, std.dev.: 0.1512)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -11.04% (0.1322 => 0.1176, std.dev.: 0.0023)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.92% (0.2006 => 0.1787, std.dev.: 0.0006)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -10.16% (51.0211 => 45.8391, std.dev.: 1.4760)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.86% (5.1587 => 4.6503, std.dev.: 0.1908)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -8.66% (0.1224 => 0.1118, std.dev.: 0.0007)
  MultiSource/Applications/aha/aha: -8.60% (0.1407 => 0.1286, std.dev.: 0.0011)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -8.19% (0.1563 => 0.1435, std.dev.: 0.0037)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -7.73% (0.1527 => 0.1409, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -7.72% (0.2151 => 0.1985, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.57% (15.9860 => 14.7757, std.dev.: 0.1305)
  MultiSource/Applications/Burg/burg: -7.54% (1.5375 => 1.4215, std.dev.: 0.0112)
  SingleSource/Benchmarks/Shootout-C++/strcat: -7.36% (0.2309 => 0.2139, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/objinst: -6.97% (0.2397 => 0.2230, std.dev.: 0.0030)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.25% (1.6793 => 1.5743, std.dev.: 0.0074)
  SingleSource/Benchmarks/Shootout-C++/ary2: -5.83% (0.2951 => 0.2779, std.dev.: 0.0022)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -5.79% (0.5748 => 0.5415, std.dev.: 0.0058)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.63% (0.2416 => 0.2280, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/hash: -5.51% (0.4554 => 0.4303, std.dev.: 0.0024)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2753 => 0.2608, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.04% (6.6236 => 6.2896, std.dev.: 0.0026)
  SingleSource/Regression/C++/ofstream_ctor: -4.92% (0.2360 => 0.2244, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.78% (0.2175 => 0.2071, std.dev.: 0.0011)
  SingleSource/Benchmarks/Linpack/linpack-pc: -4.71% (0.2738 => 0.2609, std.dev.: 0.0005)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.42% (0.2961 => 0.2830, std.dev.: 0.0031)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.35% (7.7211 => 7.3851, std.dev.: 0.0822)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.24% (0.4293 => 0.4111, std.dev.: 0.0021)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.72% (0.9964 => 0.9593, std.dev.: 0.0117)
  SingleSource/Benchmarks/Shootout-C++/lists: -3.63% (0.2837 => 0.2734, std.dev.: 0.0013)
  MultiSource/Applications/ClamAV/clamscan: -3.47% (17.3229 => 16.7213, std.dev.: 0.1983)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -3.40% (0.3848 => 0.3717, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.32% (0.3617 => 0.3497, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/sieve: -3.30% (0.3088 => 0.2986, std.dev.: 0.0032)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.95% (0.9957 => 0.9663, std.dev.: 0.0091)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -2.90% (0.4138 => 0.4018, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.29% (0.9599 => 0.9475, std.dev.: 0.0037)
  MultiSource/Applications/siod/siod: -1.02% (2.4944 => 2.4690, std.dev.: 0.0054)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.36% (1.2911 => 0.7313, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.64% (4.4050 => 3.2314, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -25.09% (6.2328 => 4.6688, std.dev.: 0.1852)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -16.97% (3.5000 => 2.9059, std.dev.: 0.1522)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.25% (25.3677 => 21.2461, std.dev.: 0.0466)
  SingleSource/Benchmarks/Misc/salsa20: -13.15% (10.3398 => 8.9799, std.dev.: 0.0052)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.00% (48.3307 => 43.0156, std.dev.: 0.2084)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -10.26% (10.2418 => 9.1913, std.dev.: 0.0940)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.21% (0.7941 => 0.7210, std.dev.: 0.0273)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.03% (3.5327 => 3.2138, std.dev.: 0.0202)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.82% (32.4581 => 29.5938, std.dev.: 0.2225)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -8.39% (2.4808 => 2.2727, std.dev.: 0.0410)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -7.96% (0.3267 => 0.3007, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.17% (3.2030 => 2.9733, std.dev.: 0.0213)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.68% (0.1945 => 0.1815, std.dev.: 0.0003)
  MultiSource/Applications/sqlite3/sqlite3: -6.31% (4.6358 => 4.3435, std.dev.: 0.0994)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.80% (0.4445 => 0.4187, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (4.5717 => 4.3152, std.dev.: 0.0113)
  MultiSource/Applications/hexxagon/hexxagon: -3.98% (15.4979 => 14.8813, std.dev.: 0.0391)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.93% (39.1740 => 37.6337, std.dev.: 0.0459)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.87% (9.1099 => 8.7578, std.dev.: 0.0316)
  SingleSource/Benchmarks/Misc/flops-7: -3.81% (1.7987 => 1.7302, std.dev.: 0.0133)
  SingleSource/Benchmarks/Misc/flops: -3.57% (10.2170 => 9.8524, std.dev.: 0.0010)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.44% (0.9806 => 0.9469, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.04% (2.8537 => 2.7669, std.dev.: 0.0158)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.83% (5.7342 => 5.5719, std.dev.: 0.0195)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.76% (1.6679 => 1.6219, std.dev.: 0.0046)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.73% (3.8665 => 3.7609, std.dev.: 0.0000)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.35% (62.4345 => 60.9683, std.dev.: 0.4497)
  SingleSource/Benchmarks/Dhrystone/dry: -2.32% (0.5126 => 0.5007, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.17% (1.6535 => 1.6176, std.dev.: 0.0027)
  SingleSource/UnitTests/Vector/multiplies: -1.99% (0.5665 => 0.5552, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.96% (4.2167 => 4.1339, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.84% (8.5243 => 8.3676, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.64% (1.3084 => 1.2870, std.dev.: 0.0045)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.38% (2.8573 => 2.8178, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.19% (3.0234 => 2.9873, std.dev.: 0.0103)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.87% (0.1441 => 0.1414, std.dev.: 0.0025)

Report Time: 0.63s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130603/e24ac18c/attachment.html>


More information about the llvm-testresults mailing list