[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jun 20 18:30:24 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12590?compare_to=12587&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12590, Order: 184495, Start Time: 2013-06-20 23:41:39, End Time: 2013-06-21 01:31:21
      To: 12587, Order: 184466, Start Time: 2013-06-20 21:27:53, End Time: 2013-06-20 23:19:08
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 22 (56 on baseline)
Performance Improvements: 18 (29 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1067 (1022 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/mason/mason: 47.38% (0.0686 => 0.1011, std.dev.: 0.0037)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 28.48% (0.2535 => 0.3257, std.dev.: 0.0188)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 20.79% (0.0529 => 0.0639, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.82% (1.5455 => 1.6972, std.dev.: 0.0437)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 8.22% (1.4263 => 1.5435, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.80% (1.5255 => 1.5988, std.dev.: 0.0255)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.42% (1.7469 => 1.8241, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.84% (1.5472 => 1.6066, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.26% (1.4707 => 1.5186, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.00% (1.5876 => 1.6353, std.dev.: 0.0165)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.40% (1.6985 => 1.7393, std.dev.: 0.0054)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 42.34% (0.0548 => 0.0780, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/moments: 14.19% (0.1085 => 0.1239, std.dev.: 0.0015)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.65% (2.5514 => 2.8742, std.dev.: 0.0423)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 10.65% (4.3939 => 4.8618, std.dev.: 0.0686)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 8.18% (0.2702 => 0.2923, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.78% (2.3370 => 2.4954, std.dev.: 0.0241)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.57% (6.1152 => 6.3334, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.50% (4.9385 => 5.1115, std.dev.: 0.0046)
  MultiSource/Applications/obsequi/Obsequi: 3.10% (2.4683 => 2.5447, std.dev.: 0.0166)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.97% (1.6214 => 1.6534, std.dev.: 0.0117)
  SingleSource/Benchmarks/Misc/whetstone: 1.00% (3.5635 => 3.5993, std.dev.: 0.0049)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -38.15% (0.0831 => 0.0514, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/mandel: -32.41% (0.0719 => 0.0486, std.dev.: 0.0026)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -30.07% (0.2281 => 0.1595, std.dev.: 0.0036)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -17.08% (0.0761 => 0.0631, std.dev.: 0.0036)
  MultiSource/Applications/lua/lua: -9.01% (5.1037 => 4.6439, std.dev.: 0.1613)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -7.95% (0.1559 => 0.1435, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.96% (0.3446 => 0.3206, std.dev.: 0.0051)
  MultiSource/Applications/minisat/minisat: -5.87% (0.8330 => 0.7841, std.dev.: 0.0169)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.23% (1.0395 => 0.9851, std.dev.: 0.0197)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.28% (1.8553 => 1.7759, std.dev.: 0.0251)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.92% (6.9773 => 6.7035, std.dev.: 0.0735)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.76% (1.4902 => 1.4491, std.dev.: 0.0151)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.87% (0.4339 => 0.4171, std.dev.: 0.0059)
  SingleSource/Benchmarks/Misc/mandel: -3.77% (1.0712 => 1.0308, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/richards_benchmark: -2.56% (1.3883 => 1.3528, std.dev.: 0.0126)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.74% (1.1405 => 1.1206, std.dev.: 0.0050)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -1.43% (1.5220 => 1.5002, std.dev.: 0.0036)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.05% (0.9558 => 0.9458, std.dev.: 0.0034)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.53% (0.1368 => 0.1430, std.dev.: 0.0166)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/mason/mason: 42.39% (0.0710 => 0.1011, std.dev.: 0.0037)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 42.04% (0.2293 => 0.3257, std.dev.: 0.0188)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.97% (0.2961 => 0.3878, std.dev.: 0.0351)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 29.12% (1.1954 => 1.5435, std.dev.: 0.0186)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 28.77% (0.2753 => 0.3545, std.dev.: 0.0293)
  MultiSource/Applications/obsequi/Obsequi: 25.30% (1.1733 => 1.4701, std.dev.: 0.0618)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 22.11% (1.2006 => 1.4661, std.dev.: 0.0574)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.10% (1.5735 => 1.7797, std.dev.: 0.0596)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.58% (1.4202 => 1.5988, std.dev.: 0.0255)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.41% (1.5372 => 1.6972, std.dev.: 0.0437)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 8.25% (1.5806 => 1.7110, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.24% (1.5108 => 1.6353, std.dev.: 0.0165)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.06% (1.6881 => 1.8241, std.dev.: 0.0123)
  MultiSource/Applications/siod/siod: 7.69% (2.4944 => 2.6861, std.dev.: 0.0725)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.66% (1.6299 => 1.7548, std.dev.: 0.0377)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.46% (1.5478 => 1.6633, std.dev.: 0.0285)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.32% (1.3667 => 1.4668, std.dev.: 0.0275)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.21% (1.4165 => 1.5186, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.11% (1.4999 => 1.6066, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.09% (1.4081 => 1.5079, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.76% (1.6292 => 1.7393, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.68% (1.4238 => 1.5189, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.84% (1.6275 => 1.7225, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.68% (1.6804 => 1.7759, std.dev.: 0.0251)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.76% (1.3833 => 1.4491, std.dev.: 0.0151)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.09% (1.4757 => 1.5360, std.dev.: 0.0210)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.88% (0.9957 => 1.0343, std.dev.: 0.0097)
  MultiSource/Benchmarks/nbench/nbench: 1.11% (1.2926 => 1.3070, std.dev.: 0.0050)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 59.51% (0.0489 => 0.0780, std.dev.: 0.0037)
  MultiSource/Applications/sgefa/sgefa: 32.47% (1.1695 => 1.5492, std.dev.: 0.0341)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.06% (16.4665 => 20.4283, std.dev.: 0.7625)
  SingleSource/Benchmarks/Shootout-C++/moments: 22.31% (0.1013 => 0.1239, std.dev.: 0.0015)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 16.40% (4.1768 => 4.8618, std.dev.: 0.0686)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.12% (6.1372 => 7.1266, std.dev.: 0.0291)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 14.09% (10.2418 => 11.6845, std.dev.: 0.2413)
  MultiSource/Applications/obsequi/Obsequi: 13.61% (2.2398 => 2.5447, std.dev.: 0.0166)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.40% (2.5800 => 2.8742, std.dev.: 0.0423)
  MultiSource/Applications/minisat/minisat: 10.28% (7.3703 => 8.1278, std.dev.: 0.0973)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.43% (5.2003 => 5.6389, std.dev.: 0.0037)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.32% (94.2966 => 99.3155, std.dev.: 1.3825)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.32% (4.6639 => 4.9118, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.68% (2.9004 => 3.0360, std.dev.: 0.0297)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.39% (40.6198 => 42.4020, std.dev.: 0.2919)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.35% (4.8986 => 5.1115, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.23% (1.0571 => 1.1018, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.22% (3.1853 => 3.3196, std.dev.: 0.0447)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.98% (5.9362 => 6.1723, std.dev.: 0.0312)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.97% (5.2788 => 5.4886, std.dev.: 0.0376)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.43% (5.5010 => 5.6895, std.dev.: 0.0328)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.19% (3.9713 => 4.0979, std.dev.: 0.0327)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.81% (1.7925 => 1.8429, std.dev.: 0.0059)
  MultiSource/Applications/lua/lua: 2.79% (28.2496 => 29.0389, std.dev.: 0.2587)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.89% (5.6582 => 5.7650, std.dev.: 0.0355)
  SingleSource/Benchmarks/Misc/ffbench: 1.45% (1.3696 => 1.3894, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.30% (11.4990 => 11.6482, std.dev.: 0.0102)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.08% (4.7814 => 4.8331, std.dev.: 0.0116)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/whetstone: -13.49% (0.1097 => 0.0949, std.dev.: 0.0045)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -6.78% (0.1563 => 0.1457, std.dev.: 0.0023)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -4.81% (51.0211 => 48.5661, std.dev.: 0.4045)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.53% (1.2911 => 0.7291, std.dev.: 0.0062)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -28.24% (0.0393 => 0.0282, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.18% (4.4050 => 3.2516, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -23.93% (6.2328 => 4.7413, std.dev.: 0.0329)
  SingleSource/Benchmarks/Misc/salsa20: -22.23% (10.3398 => 8.0408, std.dev.: 0.4585)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.09% (25.3677 => 21.2872, std.dev.: 0.1534)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -13.90% (11.6227 => 10.0073, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -9.75% (7.0179 => 6.3334, std.dev.: 0.0145)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.20% (1.6679 => 1.5145, std.dev.: 0.0281)
  MultiSource/Applications/lambda-0_1_3/lambda: -8.50% (9.1099 => 8.3358, std.dev.: 0.0040)
  MultiSource/Applications/siod/siod: -8.32% (3.7240 => 3.4142, std.dev.: 0.0480)
  SingleSource/Benchmarks/Shootout-C++/hash: -7.88% (0.7941 => 0.7315, std.dev.: 0.0109)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.69% (48.3307 => 44.6147, std.dev.: 0.4016)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.26% (9.8728 => 9.2547, std.dev.: 0.1350)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.16% (0.4445 => 0.4171, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.96% (4.5717 => 4.2994, std.dev.: 0.0168)
  SingleSource/Benchmarks/Misc/flops: -5.77% (10.2170 => 9.6278, std.dev.: 0.0926)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.43% (4.2167 => 4.0299, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.09% (5.3184 => 5.1007, std.dev.: 0.0608)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.93% (5.3276 => 5.1183, std.dev.: 0.0249)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.55% (0.9806 => 0.9458, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout/sieve: -2.90% (8.0178 => 7.7854, std.dev.: 0.0186)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.84% (3.8665 => 3.7568, std.dev.: 0.0289)
  MultiSource/Applications/sqlite3/sqlite3: -1.95% (4.6358 => 4.5456, std.dev.: 0.0306)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.50% (4.5094 => 4.4416, std.dev.: 0.0027)
  MultiSource/Applications/hexxagon/hexxagon: -1.06% (15.4979 => 15.3343, std.dev.: 0.0336)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.76% (0.1441 => 0.1430, std.dev.: 0.0166)

Report Time: 1.65s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130620/b13cb260/attachment.html>


More information about the llvm-testresults mailing list