[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jun 24 22:16:16 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12729?compare_to=12726&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12729, Order: 184823, Start Time: 2013-06-25 03:32:23, End Time: 2013-06-25 05:17:18
      To: 12726, Order: 184801, Start Time: 2013-06-25 01:18:40, End Time: 2013-06-25 03:09:25
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 3 (22 on baseline)
Performance Improvements: 58 (65 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1046 (1020 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.41% (1.0561 => 1.1027, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.48% (9.0249 => 9.2483, std.dev.: 0.0678)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (2.5399 => 2.5843, std.dev.: 0.0111)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/conditional-gnu-ext-cxx: -56.09% (0.0271 => 0.0119, std.dev.: 0.0028)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: -38.38% (0.0357 => 0.0220, std.dev.: 0.0023)
  SingleSource/UnitTests/stmtexpr: -36.89% (0.0309 => 0.0195, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -33.20% (0.0777 => 0.0519, std.dev.: 0.0009)
  SingleSource/UnitTests/AtomicOps: -33.12% (0.0317 => 0.0212, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/ccc: -32.65% (0.0389 => 0.0262, std.dev.: 0.0013)
  MultiSource/Applications/spiff/spiff: -32.53% (1.3906 => 0.9383, std.dev.: 0.1333)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -28.92% (1.6602 => 1.1801, std.dev.: 0.0062)
  SingleSource/UnitTests/SignlessTypes/div: -26.55% (0.0452 => 0.0332, std.dev.: 0.0008)
  MultiSource/Benchmarks/Olden/tsp/tsp: -22.06% (0.1777 => 0.1385, std.dev.: 0.0022)
  MultiSource/Benchmarks/Olden/power/power: -18.78% (0.1741 => 0.1414, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/health/health: -18.38% (0.1937 => 0.1581, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -16.30% (0.1552 => 0.1299, std.dev.: 0.0033)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -16.11% (1.4159 => 1.1878, std.dev.: 0.0609)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -12.48% (0.3277 => 0.2868, std.dev.: 0.0010)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -11.37% (0.1267 => 0.1123, std.dev.: 0.0020)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -11.27% (0.1349 => 0.1197, std.dev.: 0.0018)
  MultiSource/Benchmarks/Olden/mst/mst: -9.57% (0.1515 => 0.1370, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/Altivec/casts: -9.21% (0.1423 => 0.1292, std.dev.: 0.0031)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -9.04% (0.2964 => 0.2696, std.dev.: 0.0041)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -8.50% (4.5596 => 4.1722, std.dev.: 0.0227)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -8.04% (0.1853 => 0.1704, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout-C++/methcall: -6.40% (0.2389 => 0.2236, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.40% (0.2639 => 0.2470, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.35% (1.8555 => 1.7377, std.dev.: 0.0428)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.12% (1.5195 => 1.4265, std.dev.: 0.0323)
  MultiSource/Applications/minisat/minisat: -4.34% (0.7987 => 0.7640, std.dev.: 0.0118)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -4.17% (0.4345 => 0.4164, std.dev.: 0.0004)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.04% (0.2726 => 0.2616, std.dev.: 0.0016)
  MultiSource/Benchmarks/mafft/pairlocalalign: -3.71% (10.9820 => 10.5749, std.dev.: 0.0519)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.59% (0.8168 => 0.7875, std.dev.: 0.0090)
  MultiSource/Benchmarks/McCat/05-eks/eks: -3.48% (0.5610 => 0.5415, std.dev.: 0.0040)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.24% (1.4786 => 1.4307, std.dev.: 0.0152)
  MultiSource/Benchmarks/sim/sim: -3.01% (0.3790 => 0.3676, std.dev.: 0.0038)
  MultiSource/Benchmarks/McCat/18-imp/imp: -2.97% (0.4070 => 0.3949, std.dev.: 0.0032)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.62% (5.1179 => 4.9838, std.dev.: 0.0241)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.53% (6.5559 => 6.3901, std.dev.: 0.0079)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.27% (0.9954 => 0.9828, std.dev.: 0.0021)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -40.46% (0.2207 => 0.1314, std.dev.: 0.0078)
  MultiSource/Benchmarks/Olden/bisort/bisort: -27.93% (0.9312 => 0.6711, std.dev.: 0.0274)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -26.48% (1.0395 => 0.7642, std.dev.: 0.0617)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -26.34% (2.0900 => 1.5394, std.dev.: 0.0416)
  MultiSource/Applications/d/make_dparser: -25.83% (0.0515 => 0.0382, std.dev.: 0.0050)
  MultiSource/Applications/minisat/minisat: -22.71% (8.0819 => 6.2465, std.dev.: 0.0881)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -19.72% (0.1212 => 0.0973, std.dev.: 0.0061)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -17.51% (0.0594 => 0.0490, std.dev.: 0.0007)
  MultiSource/Benchmarks/Olden/health/health: -9.87% (0.3657 => 0.3296, std.dev.: 0.0078)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -8.46% (0.3429 => 0.3139, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -5.46% (41.7167 => 39.4401, std.dev.: 0.6916)
  MultiSource/Benchmarks/Olden/tsp/tsp: -5.41% (1.6965 => 1.6048, std.dev.: 0.0112)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -5.04% (2.5950 => 2.4641, std.dev.: 0.0276)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.63% (63.9732 => 61.0108, std.dev.: 1.0244)
  MultiSource/Benchmarks/FreeBench/distray/distray: -4.32% (0.2313 => 0.2213, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -3.32% (4.1069 => 3.9704, std.dev.: 0.0529)
  MultiSource/Benchmarks/Olden/power/power: -2.98% (1.2868 => 1.2484, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.11% (4.6719 => 4.5732, std.dev.: 0.0369)
  SingleSource/Benchmarks/Misc/lowercase: -1.76% (0.7855 => 0.7717, std.dev.: 0.0027)
  MultiSource/Applications/siod/siod: -1.65% (3.4442 => 3.3874, std.dev.: 0.0151)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -9.54% (0.1426 => 0.1290, std.dev.: 0.0049)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.32% (0.2721 => 0.2893, std.dev.: 0.0013)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 33.50% (1.1695 => 1.5613, std.dev.: 0.0260)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 23.13% (16.4665 => 20.2754, std.dev.: 1.3839)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.93% (6.1372 => 7.2378, std.dev.: 0.0283)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 8.67% (10.2418 => 11.1298, std.dev.: 0.2454)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.03% (5.2003 => 5.6177, std.dev.: 0.0267)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.18% (3.1853 => 3.3822, std.dev.: 0.0433)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.86% (3.2201 => 3.3765, std.dev.: 0.0361)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.64% (4.6639 => 4.8805, std.dev.: 0.0237)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.38% (0.3860 => 0.4029, std.dev.: 0.0033)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.38% (2.8994 => 3.0263, std.dev.: 0.0047)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.31% (1.0571 => 1.1027, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.34% (5.2788 => 5.4550, std.dev.: 0.0210)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.05% (4.8966 => 5.0458, std.dev.: 0.0368)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.01% (5.5010 => 5.6664, std.dev.: 0.0174)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.44% (4.3727 => 4.4795, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.27% (4.6379 => 4.7432, std.dev.: 0.0355)
  SingleSource/Benchmarks/Shootout/methcall: 1.92% (8.3425 => 8.5025, std.dev.: 0.0343)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.71% (2.5408 => 2.5843, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.55% (5.6582 => 5.7460, std.dev.: 0.0247)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.41% (3.6122 => 3.6630, std.dev.: 0.0159)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.33% (3.9713 => 4.0243, std.dev.: 0.0120)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -17.81% (0.0803 => 0.0660, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -15.33% (0.0750 => 0.0635, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.82% (0.1151 => 0.1015, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.22% (0.2006 => 0.1801, std.dev.: 0.0053)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.96% (51.0211 => 45.9402, std.dev.: 1.9063)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -9.65% (0.1886 => 0.1704, std.dev.: 0.0057)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (0.1224 => 0.1123, std.dev.: 0.0020)
  MultiSource/Benchmarks/McCat/18-imp/imp: -5.95% (0.4199 => 0.3949, std.dev.: 0.0032)
  MultiSource/Benchmarks/McCat/09-vor/vor: -5.05% (0.3723 => 0.3535, std.dev.: 0.0010)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.98% (0.2753 => 0.2616, std.dev.: 0.0016)
  MultiSource/Benchmarks/McCat/05-eks/eks: -4.97% (0.5698 => 0.5415, std.dev.: 0.0040)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -4.07% (0.5748 => 0.5514, std.dev.: 0.0071)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.92% (0.2961 => 0.2845, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.53% (6.6236 => 6.3901, std.dev.: 0.0079)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.51% (1.3686 => 1.3205, std.dev.: 0.0128)
  MultiSource/Benchmarks/Olden/bh/bh: -3.27% (0.3429 => 0.3317, std.dev.: 0.0032)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.88% (0.3853 => 0.3742, std.dev.: 0.0025)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -1.71% (1.2006 => 1.1801, std.dev.: 0.0062)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.47% (0.7334 => 0.7226, std.dev.: 0.0006)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.41% (10.7257 => 10.5749, std.dev.: 0.0519)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.30% (0.9957 => 0.9828, std.dev.: 0.0021)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.54% (1.2911 => 0.7289, std.dev.: 0.0077)
  MultiSource/Benchmarks/Olden/mst/mst: -37.40% (0.2099 => 0.1314, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -36.37% (4.4050 => 2.8030, std.dev.: 0.0074)
  MultiSource/Applications/lemon/lemon: -32.05% (1.3499 => 0.9173, std.dev.: 0.0960)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -25.73% (6.2328 => 4.6291, std.dev.: 0.1027)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -25.45% (1.0251 => 0.7642, std.dev.: 0.0617)
  MultiSource/Benchmarks/Olden/bisort/bisort: -22.02% (0.8606 => 0.6711, std.dev.: 0.0274)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.93% (4.8986 => 3.8731, std.dev.: 0.1027)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -19.69% (5.7264 => 4.5991, std.dev.: 0.0490)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.24% (25.3677 => 21.2468, std.dev.: 0.3521)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -15.84% (1.8291 => 1.5394, std.dev.: 0.0416)
  MultiSource/Applications/minisat/minisat: -15.25% (7.3703 => 6.2465, std.dev.: 0.0881)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -14.01% (11.6227 => 9.9945, std.dev.: 0.0083)
  SingleSource/Benchmarks/Misc/salsa20: -13.13% (10.3398 => 8.9827, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.29% (7.0179 => 6.2958, std.dev.: 0.0915)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.48% (1.6679 => 1.5098, std.dev.: 0.0167)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.27% (0.7941 => 0.7205, std.dev.: 0.0244)
  MultiSource/Applications/siod/siod: -9.04% (3.7240 => 3.3874, std.dev.: 0.0151)
  MultiSource/Applications/lambda-0_1_3/lambda: -8.97% (9.1099 => 8.2924, std.dev.: 0.0349)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -8.85% (4.5717 => 4.1672, std.dev.: 0.0150)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.39% (3.2030 => 2.9664, std.dev.: 0.0348)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.03% (3.5327 => 3.2843, std.dev.: 0.0609)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.86% (48.3307 => 45.0157, std.dev.: 0.4894)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.84% (0.1945 => 0.1812, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.77% (5.5889 => 5.2108, std.dev.: 0.1023)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.33% (9.8728 => 9.2483, std.dev.: 0.0678)
  MultiSource/Benchmarks/FreeBench/distray/distray: -5.10% (0.2332 => 0.2213, std.dev.: 0.0039)
  MultiSource/Applications/sqlite3/sqlite3: -5.00% (4.6358 => 4.4041, std.dev.: 0.0367)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.73% (5.3184 => 5.0671, std.dev.: 0.0164)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.68% (4.2167 => 4.0193, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.21% (5.3276 => 5.1032, std.dev.: 0.0110)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.12% (0.9806 => 0.9402, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/flops: -4.10% (10.2170 => 9.7986, std.dev.: 0.0153)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.58% (2.8537 => 2.7515, std.dev.: 0.0274)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.40% (1.6613 => 1.6048, std.dev.: 0.0112)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.09% (6.3757 => 6.1784, std.dev.: 0.0228)
  SingleSource/Benchmarks/Shootout/sieve: -3.00% (8.0178 => 7.7770, std.dev.: 0.0103)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.85% (3.8665 => 3.7563, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.22% (4.5094 => 4.4095, std.dev.: 0.0077)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.20% (5.7342 => 5.6081, std.dev.: 0.0477)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.97% (8.5243 => 8.3566, std.dev.: 0.0206)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.32% (12.1841 => 12.0232, std.dev.: 0.0524)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -1.13% (1.6105 => 1.5923, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.02% (4.9946 => 4.9437, std.dev.: 0.0152)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -10.48% (0.1441 => 0.1290, std.dev.: 0.0049)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130625/5882e36b/attachment.html>


More information about the llvm-testresults mailing list