[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Oct 16 07:35:48 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16371?compare_to=16368&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16371, Order: 192786, Start Time: 2013-10-16 12:46:09, End Time: 2013-10-16 14:38:59
      To: 16368, Order: 192778, Start Time: 2013-10-16 10:31:53, End Time: 2013-10-16 12:24:19
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 34 (49 on baseline)
Performance Improvements: 24 (19 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1049 (1039 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 63.00% (0.0227 => 0.0370, std.dev.: 0.0006)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 50.02% (0.2851 => 0.4277, std.dev.: 0.0364)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.91% (0.0572 => 0.0806, std.dev.: 0.0061)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.91% (1.7299 => 2.0570, std.dev.: 0.1128)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 17.67% (0.2167 => 0.2550, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 16.96% (1.3290 => 1.5544, std.dev.: 0.0455)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.82% (1.2216 => 1.4149, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.21% (1.3213 => 1.5091, std.dev.: 0.0581)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 13.61% (1.2373 => 1.4057, std.dev.: 0.0455)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.55% (1.3487 => 1.5180, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.20% (1.2145 => 1.3627, std.dev.: 0.0416)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.94% (1.3361 => 1.4823, std.dev.: 0.0534)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.36% (1.2224 => 1.3490, std.dev.: 0.0457)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.22% (1.2636 => 1.3928, std.dev.: 0.0293)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.12% (2.5778 => 2.8387, std.dev.: 0.0368)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.23% (1.2339 => 1.3478, std.dev.: 0.0434)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.53% (1.2796 => 1.3888, std.dev.: 0.0288)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.91% (1.3472 => 1.4537, std.dev.: 0.0388)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 7.51% (0.2144 => 0.2305, std.dev.: 0.0014)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: 9.44% (6.9806 => 7.6394, std.dev.: 0.2290)
  MultiSource/Benchmarks/PAQ8p/paq8p: 7.08% (97.9260 => 104.8576, std.dev.: 0.8042)
  SingleSource/Benchmarks/Misc/salsa20: 6.99% (7.5577 => 8.0863, std.dev.: 0.0476)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.85% (6.0880 => 6.4443, std.dev.: 0.0278)
  MultiSource/Applications/aha/aha: 5.50% (3.5826 => 3.7796, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.43% (4.5794 => 4.7824, std.dev.: 0.0617)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.29% (0.3798 => 0.3961, std.dev.: 0.0030)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.86% (39.7544 => 41.2907, std.dev.: 0.2834)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.16% (0.7003 => 0.7224, std.dev.: 0.0081)
  SingleSource/Benchmarks/Shootout/lists: 2.95% (7.2863 => 7.5014, std.dev.: 0.0115)
  MultiSource/Applications/sgefa/sgefa: 2.42% (0.8961 => 0.9178, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.86% (3.6044 => 3.6714, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.83% (3.5452 => 3.6101, std.dev.: 0.0200)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.75% (1.7800 => 1.8111, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.72% (6.5330 => 6.6451, std.dev.: 0.0384)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -27.80% (0.0921 => 0.0665, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -22.90% (0.0987 => 0.0761, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -17.28% (0.0955 => 0.0790, std.dev.: 0.0002)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -16.46% (0.1130 => 0.0944, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -16.15% (0.0879 => 0.0737, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -14.89% (0.1061 => 0.0903, std.dev.: 0.0025)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -9.71% (8.4216 => 7.6041, std.dev.: 0.0755)
  SingleSource/Benchmarks/SmallPT/smallpt: -8.42% (0.1532 => 0.1403, std.dev.: 0.0031)
  MultiSource/Applications/spiff/spiff: -4.80% (0.9578 => 0.9118, std.dev.: 0.0139)
  MultiSource/Applications/d/make_dparser: -4.34% (3.8187 => 3.6528, std.dev.: 0.0262)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -13.88% (0.3847 => 0.3313, std.dev.: 0.0163)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -13.67% (0.1975 => 0.1705, std.dev.: 0.0015)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -13.32% (0.3850 => 0.3337, std.dev.: 0.0152)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -8.57% (66.6752 => 60.9606, std.dev.: 0.4450)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.34% (3.1182 => 2.8894, std.dev.: 0.0749)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.63% (2.5139 => 2.3724, std.dev.: 0.0078)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.43% (2.9464 => 2.7863, std.dev.: 0.0311)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.75% (3.7790 => 3.5994, std.dev.: 0.0201)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.18% (5.0398 => 4.8289, std.dev.: 0.0451)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.65% (0.4824 => 0.4648, std.dev.: 0.0061)
  SingleSource/Benchmarks/Misc/fp-convert: -1.83% (7.7628 => 7.6207, std.dev.: 0.0342)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.32% (2.5517 => 2.5179, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.08% (16.8166 => 16.6357, std.dev.: 0.0434)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.01% (11.9549 => 11.8336, std.dev.: 0.0469)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.15% (0.1441 => 0.1410, std.dev.: 0.0293)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 74.53% (0.0212 => 0.0370, std.dev.: 0.0006)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 50.23% (0.2847 => 0.4277, std.dev.: 0.0364)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 43.42% (0.0562 => 0.0806, std.dev.: 0.0061)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 24.93% (1.6465 => 2.0570, std.dev.: 0.1128)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 17.07% (1.3278 => 1.5544, std.dev.: 0.0455)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 16.70% (1.2932 => 1.5091, std.dev.: 0.0581)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.49% (0.2189 => 0.2550, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.50% (1.2250 => 1.4149, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 14.89% (1.2235 => 1.4057, std.dev.: 0.0455)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.70% (1.3235 => 1.5180, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.49% (1.2007 => 1.3627, std.dev.: 0.0416)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 12.95% (1.3123 => 1.4823, std.dev.: 0.0534)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.29% (24.6139 => 27.6398, std.dev.: 0.8876)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.15% (1.2948 => 1.4521, std.dev.: 0.0577)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.52% (1.2086 => 1.3478, std.dev.: 0.0434)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.01% (1.2152 => 1.3490, std.dev.: 0.0457)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.98% (1.2550 => 1.3928, std.dev.: 0.0293)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.90% (1.2523 => 1.3888, std.dev.: 0.0288)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.60% (2.5666 => 2.8387, std.dev.: 0.0368)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 10.44% (44.2807 => 48.9032, std.dev.: 1.5355)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 10.38% (0.1012 => 0.1117, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.72% (1.3249 => 1.4537, std.dev.: 0.0388)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 7.26% (0.2149 => 0.2305, std.dev.: 0.0014)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.50% (2.6492 => 2.8213, std.dev.: 0.0370)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.65% (7.2661 => 7.6041, std.dev.: 0.0755)
  MultiSource/Applications/d/make_dparser: 4.48% (3.4962 => 3.6528, std.dev.: 0.0262)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.89% (1.0952 => 1.1268, std.dev.: 0.0122)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.47% (7.6426 => 12.4937, std.dev.: 0.0834)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 23.24% (1.1431 => 1.4087, std.dev.: 0.0729)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.56% (2.4753 => 2.7863, std.dev.: 0.0311)
  MultiSource/Benchmarks/Bullet/bullet: 8.62% (7.0333 => 7.6394, std.dev.: 0.2290)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.34% (96.7834 => 104.8576, std.dev.: 0.8042)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.30% (4.1011 => 4.3593, std.dev.: 0.0687)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.24% (3.1730 => 3.3711, std.dev.: 0.0655)
  MultiSource/Applications/aha/aha: 5.78% (3.5731 => 3.7796, std.dev.: 0.0051)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.49% (6.1088 => 6.4443, std.dev.: 0.0278)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.55% (4.5744 => 4.7824, std.dev.: 0.0617)
  SingleSource/Benchmarks/Misc/salsa20: 3.72% (7.7964 => 8.0863, std.dev.: 0.0476)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.41% (5.6951 => 5.8893, std.dev.: 0.0749)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.35% (39.9519 => 41.2907, std.dev.: 0.2834)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.35% (89.7126 => 92.7187, std.dev.: 0.1263)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.3836 => 0.3961, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.22% (6.5990 => 6.8113, std.dev.: 0.0672)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.77% (2.3084 => 2.3724, std.dev.: 0.0078)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.60% (1.7652 => 1.8111, std.dev.: 0.0091)
  SingleSource/Benchmarks/Shootout/lists: 1.78% (7.3703 => 7.5014, std.dev.: 0.0115)
  MultiSource/Applications/siod/siod: 1.57% (3.5310 => 3.5866, std.dev.: 0.0186)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.35% (16.7972 => 17.0236, std.dev.: 0.0049)
  SingleSource/Benchmarks/Shootout/methcall: 1.09% (8.5434 => 8.6361, std.dev.: 0.0174)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.23% (0.1483 => 0.1183, std.dev.: 0.0083)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.80% (0.5226 => 0.2362, std.dev.: 0.0809)
  MultiSource/Applications/sgefa/sgefa: -41.87% (1.5790 => 0.9178, std.dev.: 0.0012)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.25% (0.0400 => 0.0263, std.dev.: 0.0052)
  MultiSource/Benchmarks/Olden/em3d/em3d: -29.23% (5.0288 => 3.5590, std.dev.: 0.0959)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.59% (57.2347 => 43.7355, std.dev.: 4.2573)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.51% (15.9508 => 13.3178, std.dev.: 0.3904)
  MultiSource/Benchmarks/FreeBench/mason/mason: -11.23% (0.3304 => 0.2933, std.dev.: 0.0143)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -10.99% (0.5066 => 0.4509, std.dev.: 0.0174)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.92% (20.8247 => 18.5497, std.dev.: 0.0988)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.05% (3.4956 => 3.1443, std.dev.: 0.0410)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.75% (50.0284 => 45.1520, std.dev.: 0.8069)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.79% (0.7474 => 0.7191, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.96% (17.1431 => 16.6357, std.dev.: 0.0434)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.93% (2.5938 => 2.5179, std.dev.: 0.0100)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.92% (3.7874 => 3.6767, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.82% (5.4473 => 5.2938, std.dev.: 0.0547)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.32% (4.3592 => 4.2579, std.dev.: 0.0246)
  SingleSource/Benchmarks/Misc/whetstone: -1.03% (3.6303 => 3.5930, std.dev.: 0.0055)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.60% (0.1348 => 0.1410, std.dev.: 0.0293)

Report Time: 0.79s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131016/61ef59df/attachment.html>


More information about the llvm-testresults mailing list