[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jun 21 21:03:04 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12631?compare_to=12628&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12631, Order: 184627, Start Time: 2013-06-22 02:18:44, End Time: 2013-06-22 04:04:05
      To: 12628, Order: 184607, Start Time: 2013-06-22 00:05:26, End Time: 2013-06-22 01:57:07
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 7 (27 on baseline)
Performance Improvements: 44 (48 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1056 (1032 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 26.34% (1.8578 => 2.3472, std.dev.: 0.0911)
  SingleSource/Benchmarks/Shootout/nestedloop: 9.55% (0.1445 => 0.1583, std.dev.: 0.0027)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.82% (0.1342 => 0.1447, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.95% (0.3777 => 0.3964, std.dev.: 0.0032)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.42% (0.4907 => 0.5124, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.00% (5.9226 => 6.1596, std.dev.: 0.0442)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.67% (1.4889 => 1.5137, std.dev.: 0.0029)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/2004-03-15-IndirectGoto: -41.61% (0.0286 => 0.0167, std.dev.: 0.0031)
  SingleSource/Regression/C++/EH/inlined_cleanup: -41.07% (0.0319 => 0.0188, std.dev.: 0.0010)
  SingleSource/Regression/C/2003-05-23-TransparentUnion: -39.35% (0.0277 => 0.0168, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout/methcall: -38.94% (0.0601 => 0.0367, std.dev.: 0.0069)
  SingleSource/Regression/C/sumarray2d: -36.83% (0.0706 => 0.0446, std.dev.: 0.0028)
  SingleSource/Regression/C++/EH/recursive-throw: -36.04% (0.0419 => 0.0268, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -35.98% (0.1170 => 0.0749, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -35.34% (0.1480 => 0.0957, std.dev.: 0.0023)
  SingleSource/UnitTests/SignlessTypes/factor: -32.56% (0.0519 => 0.0350, std.dev.: 0.0002)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -27.86% (0.0718 => 0.0518, std.dev.: 0.0046)
  SingleSource/Regression/C/test_indvars: -26.17% (0.0405 => 0.0299, std.dev.: 0.0027)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -25.20% (0.0508 => 0.0380, std.dev.: 0.0030)
  MultiSource/Applications/sgefa/sgefa: -21.03% (0.5183 => 0.4093, std.dev.: 0.0419)
  SingleSource/Regression/C/sumarraymalloc: -20.18% (0.0550 => 0.0439, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -19.82% (6.3420 => 5.0848, std.dev.: 0.3346)
  SingleSource/Benchmarks/Shootout/heapsort: -18.60% (0.0570 => 0.0464, std.dev.: 0.0011)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -15.21% (0.0664 => 0.0563, std.dev.: 0.0003)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -13.77% (0.1300 => 0.1121, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -13.41% (0.0992 => 0.0859, std.dev.: 0.0009)
  MultiSource/Applications/JM/lencod/lencod: -12.49% (19.2376 => 16.8342, std.dev.: 0.1259)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -12.49% (0.1706 => 0.1493, std.dev.: 0.0056)
  SingleSource/Regression/C++/ofstream_ctor: -11.57% (0.2645 => 0.2339, std.dev.: 0.0105)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -10.60% (6.3209 => 5.6506, std.dev.: 0.0340)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.98% (1.0120 => 0.9312, std.dev.: 0.0168)
  MultiSource/Benchmarks/MallocBench/gs/gs: -7.47% (5.0754 => 4.6965, std.dev.: 0.0472)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.77% (1.6298 => 1.5195, std.dev.: 0.0402)
  MultiSource/Applications/ClamAV/clamscan: -6.02% (17.8649 => 16.7896, std.dev.: 0.1298)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.64% (0.5446 => 0.5248, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.42% (1.5272 => 1.4749, std.dev.: 0.0145)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.22% (0.4412 => 0.4270, std.dev.: 0.0004)
  MultiSource/Applications/lemon/lemon: -3.08% (1.2616 => 1.2227, std.dev.: 0.0131)
  MultiSource/Applications/lambda-0_1_3/lambda: -2.72% (0.8419 => 0.8190, std.dev.: 0.0060)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.59% (1.6086 => 1.5670, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.59% (1.7368 => 1.6919, std.dev.: 0.0152)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.14% (0.5900 => 0.5774, std.dev.: 0.0047)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -1.19% (1.1982 => 1.1840, std.dev.: 0.0020)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/d/make_dparser: -31.94% (0.0573 => 0.0390, std.dev.: 0.0006)
  MultiSource/Applications/JM/ldecod/ldecod: -28.26% (0.0913 => 0.0655, std.dev.: 0.0014)
  MultiSource/Applications/lemon/lemon: -10.22% (1.0602 => 0.9518, std.dev.: 0.0406)
  SingleSource/Benchmarks/Shootout/strcat: -8.83% (0.1596 => 0.1455, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.48% (4.7174 => 4.6004, std.dev.: 0.0066)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.08% (2.5786 => 2.5249, std.dev.: 0.0081)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.51% (3.3428 => 3.2922, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.03% (3.2244 => 3.1911, std.dev.: 0.0019)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 5.26% (0.1313 => 0.1382, std.dev.: 0.0279)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.21% (0.2721 => 0.2890, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.12% (1.4165 => 1.4749, std.dev.: 0.0145)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.02% (0.3410 => 0.3513, std.dev.: 0.0027)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 2.68% (1.5862 => 1.6287, std.dev.: 0.0089)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 33.64% (1.1695 => 1.5629, std.dev.: 0.0230)
  SingleSource/Benchmarks/Misc/pi: 28.14% (1.8318 => 2.3472, std.dev.: 0.0911)
  SingleSource/Benchmarks/Stanford/Puzzle: 21.10% (0.1455 => 0.1762, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.01% (6.1372 => 7.1200, std.dev.: 0.1090)
  SingleSource/Benchmarks/Shootout/nestedloop: 12.35% (0.1409 => 0.1583, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.80% (5.2003 => 5.6060, std.dev.: 0.0783)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.81% (3.1853 => 3.3704, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.87% (3.2201 => 3.3770, std.dev.: 0.0307)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.67% (4.6639 => 4.8815, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.04% (2.9004 => 3.0175, std.dev.: 0.0059)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.01% (94.2966 => 98.0822, std.dev.: 0.9586)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.76% (5.9362 => 6.1596, std.dev.: 0.0442)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.42% (1.0571 => 1.0932, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.06% (5.5010 => 5.6692, std.dev.: 0.0425)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.05% (4.8966 => 5.0459, std.dev.: 0.0035)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.01% (39.9248 => 41.1276, std.dev.: 0.1841)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.73% (0.4988 => 0.5124, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.69% (0.3860 => 0.3964, std.dev.: 0.0032)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.39% (1.4783 => 1.5137, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.75% (5.6582 => 5.7570, std.dev.: 0.0067)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.74% (3.9713 => 4.0405, std.dev.: 0.0081)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.61% (4.3727 => 4.4430, std.dev.: 0.0151)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.21% (2.9023 => 2.9374, std.dev.: 0.0106)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -34.95% (0.1113 => 0.0724, std.dev.: 0.0003)
  MultiSource/Applications/viterbi/viterbi: -24.06% (0.2431 => 0.1846, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.81% (0.0803 => 0.0668, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/whetstone: -14.77% (0.1097 => 0.0935, std.dev.: 0.0017)
  MultiSource/Applications/JM/lencod/lencod: -11.11% (18.9387 => 16.8342, std.dev.: 0.1259)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.07% (0.2006 => 0.1804, std.dev.: 0.0053)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -9.71% (1.0314 => 0.9312, std.dev.: 0.0168)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.06% (0.8025 => 0.7378, std.dev.: 0.0049)
  MultiSource/Applications/lemon/lemon: -7.05% (1.3155 => 1.2227, std.dev.: 0.0131)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.69% (1.6793 => 1.5670, std.dev.: 0.0085)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -6.53% (0.1563 => 0.1461, std.dev.: 0.0019)
  MultiSource/Applications/lambda-0_1_3/lambda: -5.31% (0.8649 => 0.8190, std.dev.: 0.0060)
  MultiSource/Applications/ClamAV/clamscan: -3.08% (17.3229 => 16.7896, std.dev.: 0.1298)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.44% (0.9957 => 0.9714, std.dev.: 0.0051)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.75% (0.8969 => 0.8812, std.dev.: 0.0058)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -1.38% (1.2006 => 1.1840, std.dev.: 0.0020)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.51% (1.2911 => 0.7293, std.dev.: 0.0009)
  MultiSource/Applications/lemon/lemon: -29.49% (1.3499 => 0.9518, std.dev.: 0.0406)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.98% (4.4050 => 3.2164, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -23.79% (6.2328 => 4.7499, std.dev.: 0.0599)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.69% (25.3677 => 21.3872, std.dev.: 0.0721)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -14.10% (11.6227 => 9.9835, std.dev.: 0.0153)
  MultiSource/Applications/minisat/minisat: -13.77% (7.3703 => 6.3552, std.dev.: 0.2123)
  SingleSource/Benchmarks/Misc/salsa20: -13.13% (10.3398 => 8.9826, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.47% (7.0179 => 6.2828, std.dev.: 0.0159)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.57% (1.6679 => 1.5082, std.dev.: 0.0403)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.10% (0.7941 => 0.7218, std.dev.: 0.0272)
  MultiSource/Applications/siod/siod: -9.08% (3.7240 => 3.3859, std.dev.: 0.0774)
  MultiSource/Applications/lambda-0_1_3/lambda: -9.05% (9.1099 => 8.2859, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -7.50% (4.2167 => 3.9005, std.dev.: 0.0898)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.37% (48.3307 => 44.7695, std.dev.: 0.7983)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.81% (3.5327 => 3.2922, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.73% (5.5889 => 5.2127, std.dev.: 0.0117)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.27% (0.1945 => 0.1823, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.14% (4.5717 => 4.2911, std.dev.: 0.0077)
  MultiSource/Applications/sqlite3/sqlite3: -4.85% (4.6358 => 4.4108, std.dev.: 0.0287)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.78% (5.3184 => 5.0640, std.dev.: 0.0711)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.47% (0.2777 => 0.2653, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.38% (5.3276 => 5.0944, std.dev.: 0.0066)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.16% (0.9806 => 0.9398, std.dev.: 0.0150)
  SingleSource/Benchmarks/Misc/flops: -4.11% (10.2170 => 9.7966, std.dev.: 0.0101)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.15% (2.8537 => 2.7638, std.dev.: 0.0119)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.08% (3.8665 => 3.7475, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout/sieve: -2.97% (8.0178 => 7.7797, std.dev.: 0.0791)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.62% (5.7342 => 5.6411, std.dev.: 0.0306)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.58% (8.5243 => 8.3892, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.52% (1.6535 => 1.6283, std.dev.: 0.0090)
  MultiSource/Applications/viterbi/viterbi: -1.32% (2.5688 => 2.5349, std.dev.: 0.0047)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.09% (0.1441 => 0.1382, std.dev.: 0.0279)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130621/aaf08b58/attachment.html>


More information about the llvm-testresults mailing list