[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 21 08:15:58 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16536?compare_to=16533&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16536, Order: 193081, Start Time: 2013-10-21 13:32:30, End Time: 2013-10-21 15:19:13
      To: 16533, Order: 193073, Start Time: 2013-10-21 11:09:28, End Time: 2013-10-21 13:05:51
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 15 (23 on baseline)
Performance Improvements: 53 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1039 (1069 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: 88.64% (24.9800 => 47.1227, std.dev.: 1.9607)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 35.15% (0.1471 => 0.1988, std.dev.: 0.0197)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.32% (0.4315 => 0.4631, std.dev.: 0.0050)
  MultiSource/Applications/obsequi/Obsequi: 7.01% (2.2194 => 2.3749, std.dev.: 0.0131)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.21% (1.7908 => 1.9020, std.dev.: 0.0115)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.03% (6.0814 => 6.4481, std.dev.: 0.0748)
  MultiSource/Applications/spiff/spiff: 4.06% (2.8240 => 2.9387, std.dev.: 0.0233)
  MultiSource/Applications/hexxagon/hexxagon: 3.99% (15.1687 => 15.7733, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.52% (5.1753 => 5.3577, std.dev.: 0.0224)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.64% (5.1162 => 5.2514, std.dev.: 0.0250)
  SingleSource/Benchmarks/Stanford/FloatMM: 2.64% (0.6970 => 0.7154, std.dev.: 0.0066)
  MultiSource/Applications/aha/aha: 2.23% (3.6965 => 3.7790, std.dev.: 0.0231)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.60% (1.2664 => 1.2866, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.59% (3.6102 => 3.6676, std.dev.: 0.0151)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.18% (12.4877 => 12.6346, std.dev.: 0.0124)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: -26.38% (0.2676 => 0.1970, std.dev.: 0.0025)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -22.66% (0.3045 => 0.2355, std.dev.: 0.0109)
  MultiSource/Benchmarks/Olden/bh/bh: -20.05% (0.4105 => 0.3282, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -19.22% (0.0817 => 0.0660, std.dev.: 0.0022)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.66% (1.6939 => 1.4117, std.dev.: 0.0089)
  MultiSource/Benchmarks/Olden/health/health: -16.47% (0.1846 => 0.1542, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -15.61% (0.0839 => 0.0708, std.dev.: 0.0028)
  MultiSource/Applications/lambda-0_1_3/lambda: -15.01% (0.9754 => 0.8290, std.dev.: 0.0181)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -14.12% (52.3028 => 44.9189, std.dev.: 1.4788)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.41% (11.7905 => 10.2095, std.dev.: 0.2995)
  MultiSource/Benchmarks/Olden/bisort/bisort: -12.99% (0.0824 => 0.0717, std.dev.: 0.0033)
  MultiSource/Applications/hexxagon/hexxagon: -12.92% (1.2086 => 1.0525, std.dev.: 0.0281)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -12.72% (0.0896 => 0.0782, std.dev.: 0.0028)
  MultiSource/Applications/hbd/hbd: -12.13% (1.8107 => 1.5911, std.dev.: 0.0276)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.91% (1.3137 => 1.1573, std.dev.: 0.0297)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -11.16% (1.4107 => 1.2533, std.dev.: 0.0229)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -10.51% (1.4099 => 1.2617, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/tsp/tsp: -10.03% (0.1525 => 0.1372, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -9.97% (0.1404 => 0.1264, std.dev.: 0.0044)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -8.98% (1.8198 => 1.6564, std.dev.: 0.0171)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -8.89% (0.3657 => 0.3332, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -8.83% (1.4457 => 1.3180, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -8.44% (1.4368 => 1.3155, std.dev.: 0.0134)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.38% (0.1719 => 0.1575, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/sieve: -8.07% (0.3124 => 0.2872, std.dev.: 0.0079)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -7.54% (1.6078 => 1.4865, std.dev.: 0.0075)
  MultiSource/Applications/minisat/minisat: -7.29% (0.8173 => 0.7577, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.74% (1.4311 => 1.3347, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.64% (1.2933 => 1.2074, std.dev.: 0.0106)
  MultiSource/Benchmarks/nbench/nbench: -5.66% (1.3495 => 1.2731, std.dev.: 0.0195)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.42% (0.2434 => 0.2302, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.89% (1.2928 => 1.2296, std.dev.: 0.0046)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.73% (0.2978 => 0.2837, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.57% (1.3364 => 1.2753, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.38% (1.3194 => 1.2616, std.dev.: 0.0026)
  MultiSource/Benchmarks/McCat/18-imp/imp: -4.33% (0.4160 => 0.3980, std.dev.: 0.0041)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.20% (0.2764 => 0.2648, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/moments: -3.99% (0.3959 => 0.3801, std.dev.: 0.0023)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.98% (1.1166 => 1.0945, std.dev.: 0.0080)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -27.86% (1.8008 => 1.2991, std.dev.: 0.0632)
  MultiSource/Benchmarks/Olden/bisort/bisort: -27.41% (0.9233 => 0.6702, std.dev.: 0.0440)
  MultiSource/Applications/lemon/lemon: -22.89% (1.1598 => 0.8943, std.dev.: 0.0268)
  MultiSource/Applications/minisat/minisat: -22.53% (8.2467 => 6.3891, std.dev.: 0.4902)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -16.31% (1.5504 => 1.2975, std.dev.: 0.0137)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -15.54% (10.9535 => 9.2515, std.dev.: 0.2346)
  MultiSource/Benchmarks/Olden/tsp/tsp: -6.32% (1.6429 => 1.5390, std.dev.: 0.0086)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.08% (2.8387 => 2.6662, std.dev.: 0.0095)
  MultiSource/Benchmarks/Olden/bh/bh: -6.01% (2.5264 => 2.3746, std.dev.: 0.0091)
  SingleSource/Benchmarks/Shootout-C++/lists: -3.67% (16.6949 => 16.0818, std.dev.: 0.0973)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.31% (6.1036 => 5.9017, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.10% (5.2567 => 5.0939, std.dev.: 0.0577)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.09% (5.8254 => 5.7035, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.72% (5.8691 => 5.7679, std.dev.: 0.0105)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.16% (0.1380 => 0.1364, std.dev.: 0.0261)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/08-main/main: 8.95% (0.2870 => 0.3127, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.92% (1.2932 => 1.3180, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.18% (1.2152 => 1.2296, std.dev.: 0.0046)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 65.32% (7.6426 => 12.6346, std.dev.: 0.0124)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 22.26% (1.1431 => 1.3976, std.dev.: 0.0527)
  MultiSource/Applications/obsequi/Obsequi: 8.52% (2.1884 => 2.3749, std.dev.: 0.0131)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.71% (2.4753 => 2.6662, std.dev.: 0.0095)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.93% (0.8273 => 0.8846, std.dev.: 0.0219)
  MultiSource/Applications/hexxagon/hexxagon: 6.71% (14.7810 => 15.7733, std.dev.: 0.0058)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0038)
  MultiSource/Applications/aha/aha: 5.76% (3.5731 => 3.7790, std.dev.: 0.0231)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.55% (6.1088 => 6.4481, std.dev.: 0.0748)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.23% (3.1730 => 3.3389, std.dev.: 0.0145)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.52% (5.3716 => 5.6143, std.dev.: 0.0293)
  MultiSource/Applications/spiff/spiff: 4.23% (2.8194 => 2.9387, std.dev.: 0.0233)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 4.17% (2.5368 => 2.6427, std.dev.: 0.0169)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.50% (89.7126 => 92.8497, std.dev.: 0.2959)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.78% (3.5683 => 3.6676, std.dev.: 0.0151)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.71% (1.8519 => 1.9020, std.dev.: 0.0115)
  MultiSource/Benchmarks/Olden/power/power: 2.42% (1.2170 => 1.2464, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.65% (4.0596 => 4.1266, std.dev.: 0.0124)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.61% (1.7652 => 1.7937, std.dev.: 0.0092)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.50% (8.1346 => 8.2569, std.dev.: 0.0137)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.76% (0.5226 => 0.2312, std.dev.: 0.0086)
  MultiSource/Applications/sgefa/sgefa: -43.50% (1.5790 => 0.8921, std.dev.: 0.0115)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.75% (0.0400 => 0.0273, std.dev.: 0.0000)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.80% (15.9508 => 12.9513, std.dev.: 0.4035)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.25% (50.0284 => 40.8958, std.dev.: 2.1450)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.67% (57.2347 => 47.1227, std.dev.: 1.9607)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.64% (20.8247 => 18.4015, std.dev.: 0.1675)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.14% (3.4956 => 3.1413, std.dev.: 0.0198)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.93% (0.3304 => 0.2976, std.dev.: 0.0055)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.36% (2.5938 => 2.4806, std.dev.: 0.0244)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.79% (4.3592 => 4.1939, std.dev.: 0.0483)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.47% (3.7437 => 3.6138, std.dev.: 0.0495)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.85% (17.1431 => 16.6548, std.dev.: 0.1143)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.55% (3.7874 => 3.6907, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/oourafft: -2.10% (3.7484 => 3.6698, std.dev.: 0.0148)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.19% (0.1348 => 0.1364, std.dev.: 0.0261)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131021/d997f268/attachment.html>


More information about the llvm-testresults mailing list