[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Oct 25 16:08:00 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16681?compare_to=16678&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16681, Order: 193433, Start Time: 2013-10-25 21:15:39, End Time: 2013-10-25 23:11:22
      To: 16678, Order: 193422, Start Time: 2013-10-25 18:46:00, End Time: 2013-10-25 20:45:39
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 25 (43 on baseline)
Performance Improvements: 34 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1048 (1046 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/random: 59.72% (0.0360 => 0.0575, std.dev.: 0.0038)
  SingleSource/Benchmarks/Stanford/Towers: 50.28% (0.0531 => 0.0798, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.61% (1.2889 => 1.5545, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 16.82% (1.3300 => 1.5537, std.dev.: 0.0556)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 16.44% (1.3589 => 1.5823, std.dev.: 0.0830)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 15.15% (1.3119 => 1.5106, std.dev.: 0.0153)
  SingleSource/Benchmarks/Shootout-C++/ary: 13.62% (0.2636 => 0.2995, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/hash2: 12.76% (0.4570 => 0.5153, std.dev.: 0.0159)
  SingleSource/Benchmarks/Shootout-C++/fibo: 12.70% (0.2126 => 0.2396, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.29% (0.6416 => 0.7012, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.81% (1.3458 => 1.4643, std.dev.: 0.0450)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary: 50.89% (0.0393 => 0.0593, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/matrix: 40.42% (2.9681 => 4.1679, std.dev.: 0.0500)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.19% (1.4873 => 1.8619, std.dev.: 0.0048)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 11.57% (0.4545 => 0.5071, std.dev.: 0.0003)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.30% (0.9024 => 0.9773, std.dev.: 0.0032)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.66% (2.4021 => 2.5862, std.dev.: 0.0366)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 6.60% (1.4148 => 1.5082, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.42% (0.3778 => 0.3945, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.80% (5.7288 => 5.9465, std.dev.: 0.0257)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.78% (5.0988 => 5.2407, std.dev.: 0.0362)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.57% (5.5414 => 5.6840, std.dev.: 0.0081)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.56% (18.2294 => 18.6962, std.dev.: 0.1734)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.13% (1.0449 => 1.0672, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.45% (3.5768 => 3.6287, std.dev.: 0.0177)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/pointer_arithmetic: -46.76% (0.0216 => 0.0115, std.dev.: 0.0009)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: -46.60% (0.0294 => 0.0157, std.dev.: 0.0043)
  SingleSource/Regression/C/badidx: -45.78% (0.0498 => 0.0270, std.dev.: 0.0007)
  SingleSource/Regression/C++/EH/ctor_dtor_count: -45.67% (0.0416 => 0.0226, std.dev.: 0.0057)
  SingleSource/UnitTests/2002-08-02-CastTest2: -45.54% (0.0224 => 0.0122, std.dev.: 0.0009)
  SingleSource/Regression/C++/2011-03-28-Bitfield: -45.30% (0.0362 => 0.0198, std.dev.: 0.0061)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -45.21% (0.0365 => 0.0200, std.dev.: 0.0031)
  SingleSource/UnitTests/2006-02-04-DivRem: -44.81% (0.0337 => 0.0186, std.dev.: 0.0044)
  SingleSource/Regression/C/globalrefs: -44.59% (0.0370 => 0.0205, std.dev.: 0.0003)
  SingleSource/Regression/C/2004-02-03-AggregateCopy: -43.80% (0.0274 => 0.0154, std.dev.: 0.0004)
  SingleSource/Regression/C/casts: -42.90% (0.0676 => 0.0386, std.dev.: 0.0020)
  SingleSource/UnitTests/2002-10-12-StructureArgsSimple: -41.78% (0.0292 => 0.0170, std.dev.: 0.0045)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: -41.49% (0.0376 => 0.0220, std.dev.: 0.0059)
  SingleSource/Regression/C/uint64_to_float: -40.65% (0.0706 => 0.0419, std.dev.: 0.0030)
  SingleSource/UnitTests/2007-01-04-KNR-Args: -40.48% (0.0336 => 0.0200, std.dev.: 0.0020)
  SingleSource/Regression/C/2008-01-07-LongDouble: -39.53% (0.0253 => 0.0153, std.dev.: 0.0006)
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: -38.23% (0.0293 => 0.0181, std.dev.: 0.0043)
  SingleSource/UnitTests/2002-05-03-NotTest: -37.58% (0.0298 => 0.0186, std.dev.: 0.0040)
  SingleSource/Regression/C/DuffsDevice: -30.13% (0.0385 => 0.0269, std.dev.: 0.0005)
  SingleSource/Regression/C/sumarray2d: -30.00% (0.0480 => 0.0336, std.dev.: 0.0002)
  SingleSource/Regression/C/bigstack: -28.00% (0.0900 => 0.0648, std.dev.: 0.0004)
  MultiSource/Applications/ClamAV/clamscan: -16.47% (20.3981 => 17.0394, std.dev.: 1.1912)
  SingleSource/Benchmarks/SmallPT/smallpt: -10.94% (0.1563 => 0.1392, std.dev.: 0.0028)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -10.14% (0.1243 => 0.1117, std.dev.: 0.0028)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.21% (0.2437 => 0.2237, std.dev.: 0.0016)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/SPASS/SPASS: -36.31% (12.5679 => 8.0048, std.dev.: 1.4871)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -35.34% (2.4211 => 1.5654, std.dev.: 0.2601)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -32.90% (5.8182 => 3.9042, std.dev.: 0.2197)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -11.28% (0.8584 => 0.7616, std.dev.: 0.0047)
  MultiSource/Applications/lambda-0_1_3/lambda: -7.16% (8.2288 => 7.6398, std.dev.: 0.0681)
  SingleSource/Benchmarks/Dhrystone/fldry: -6.73% (0.7253 => 0.6765, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.24% (0.3112 => 0.2949, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.24% (22.6023 => 21.4188, std.dev.: 0.2648)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.31% (3.5871 => 3.4325, std.dev.: 0.0404)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.37% (0.1365 => 0.1370, std.dev.: 0.0028)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/random: 69.12% (0.0340 => 0.0575, std.dev.: 0.0038)
  SingleSource/Benchmarks/Stanford/Towers: 61.21% (0.0495 => 0.0798, std.dev.: 0.0093)
  SingleSource/Benchmarks/Misc/whetstone: 48.05% (0.0874 => 0.1294, std.dev.: 0.0144)
  SingleSource/Benchmarks/Shootout-C++/fibo: 26.17% (0.1899 => 0.2396, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 24.13% (1.2523 => 1.5545, std.dev.: 0.0125)
  SingleSource/Benchmarks/Shootout-C++/ary: 21.06% (0.2474 => 0.2995, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.69% (1.2981 => 1.5537, std.dev.: 0.0556)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.43% (1.3249 => 1.5823, std.dev.: 0.0830)
  SingleSource/Benchmarks/Shootout-C++/hash2: 17.94% (0.4369 => 0.5153, std.dev.: 0.0159)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 15.94% (1.2630 => 1.4643, std.dev.: 0.0450)
  SingleSource/Benchmarks/Shootout-C++/lists1: 15.87% (0.3087 => 0.3577, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 15.60% (1.3068 => 1.5106, std.dev.: 0.0153)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.37% (0.6296 => 0.7012, std.dev.: 0.0077)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 4.52% (0.2259 => 0.2361, std.dev.: 0.0016)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.48% (4.6423 => 4.7572, std.dev.: 0.0233)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 70.58% (3.0111 => 5.1363, std.dev.: 0.4554)
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.62% (7.6426 => 12.2759, std.dev.: 0.1275)
  SingleSource/Benchmarks/Shootout-C++/ary: 55.64% (0.0381 => 0.0593, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/matrix: 45.97% (2.8554 => 4.1679, std.dev.: 0.0500)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 31.94% (1.1431 => 1.5082, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.55% (1.4830 => 1.8619, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout/ary3: 22.22% (4.6972 => 5.7409, std.dev.: 0.1464)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 18.39% (30.1838 => 35.7352, std.dev.: 1.0684)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.13% (0.8273 => 0.9773, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout-C++/fibo: 9.84% (4.9428 => 5.4294, std.dev.: 0.1224)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 9.13% (23.4704 => 25.6129, std.dev.: 0.1689)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.71% (2.4010 => 2.5862, std.dev.: 0.0366)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.82% (5.3716 => 5.6840, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.58% (5.9061 => 6.2359, std.dev.: 0.1015)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.41% (5.6951 => 5.9465, std.dev.: 0.0257)
  SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.7964 => 8.1048, std.dev.: 0.0922)
  MultiSource/Applications/spiff/spiff: 3.92% (2.8194 => 2.9298, std.dev.: 0.0367)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.76% (0.2842 => 0.2949, std.dev.: 0.0001)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.13% (89.7126 => 92.5201, std.dev.: 0.4774)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.03% (2.5368 => 2.6136, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.80% (5.0980 => 5.2407, std.dev.: 0.0362)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 2.78% (0.7410 => 0.7616, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.07% (3.5550 => 3.6287, std.dev.: 0.0177)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.01% (5.3022 => 5.4090, std.dev.: 0.0293)
  SingleSource/Benchmarks/Misc/flops: 1.87% (9.4433 => 9.6199, std.dev.: 0.0392)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.86% (1.0477 => 1.0672, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.71% (1.5940 => 1.6213, std.dev.: 0.0106)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.51% (16.7972 => 17.0512, std.dev.: 0.0630)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -52.49% (0.5226 => 0.2483, std.dev.: 0.0563)
  MultiSource/Applications/sgefa/sgefa: -42.26% (1.5790 => 0.9117, std.dev.: 0.0015)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.37% (15.9508 => 13.3403, std.dev.: 0.6328)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.45% (50.0284 => 43.2998, std.dev.: 2.5639)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.22% (20.8247 => 18.6962, std.dev.: 0.1734)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.46% (3.4956 => 3.1650, std.dev.: 0.0103)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.31% (3.7437 => 3.4325, std.dev.: 0.0404)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.10% (1.0695 => 0.9829, std.dev.: 0.0133)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.53% (3.0561 => 2.8564, std.dev.: 0.0513)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.08% (8.1346 => 7.6398, std.dev.: 0.0681)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.61% (2.5938 => 2.4742, std.dev.: 0.0268)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.28% (0.7287 => 0.7048, std.dev.: 0.0065)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.92% (3.7874 => 3.6768, std.dev.: 0.0061)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.74% (2.4471 => 2.3801, std.dev.: 0.0218)
  SingleSource/Benchmarks/Shootout/lists: -2.69% (7.3703 => 7.1717, std.dev.: 0.0465)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.47% (17.1431 => 16.7198, std.dev.: 0.0937)
  SingleSource/Benchmarks/Misc/oourafft: -1.72% (3.7484 => 3.6841, std.dev.: 0.0178)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.35% (2.1472 => 2.1182, std.dev.: 0.0042)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.63% (0.1348 => 0.1370, std.dev.: 0.0028)

Report Time: 0.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131025/aada3fc4/attachment.html>


More information about the llvm-testresults mailing list