[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Oct 27 23:26:58 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16754?compare_to=16751&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16754, Order: 193512, Start Time: 2013-10-28 04:45:26, End Time: 2013-10-28 06:30:23
      To: 16751, Order: 193509, Start Time: 2013-10-27 23:13:46, End Time: 2013-10-28 00:54:35
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 11 (49 on baseline)
Performance Improvements: 1 (29 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1095 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.80% (0.3822 => 0.3929, std.dev.: 0.0018)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.69% (0.0886 => 0.1025, std.dev.: 0.0002)
  MultiSource/Benchmarks/PAQ8p/paq8p: 7.79% (96.3868 => 103.8959, std.dev.: 1.9784)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.34% (2.1204 => 2.2124, std.dev.: 0.0002)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.45% (3.5487 => 3.6358, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.20% (3.6395 => 3.7194, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.83% (5.9048 => 6.0129, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.41% (2.9052 => 2.9463, std.dev.: 0.0097)
  MultiSource/Applications/spiff/spiff: 1.40% (2.9566 => 2.9979, std.dev.: 0.0159)
  MultiSource/Applications/aha/aha: 1.35% (3.7215 => 3.7716, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.17% (5.0512 => 5.1104, std.dev.: 0.0006)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.52% (2.3328 => 2.2506, std.dev.: 0.0220)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.44% (0.1367 => 0.1373, std.dev.: 0.0237)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/siod/siod: 4.24% (2.4480 => 2.5519, std.dev.: 0.0266)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.86% (0.5705 => 0.5868, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.80% (0.3822 => 0.3929, std.dev.: 0.0018)
  MultiSource/Benchmarks/Bullet/bullet: 2.52% (32.7552 => 33.5796, std.dev.: 0.0568)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.24% (0.6439 => 0.6583, std.dev.: 0.0054)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.18% (0.5609 => 0.5731, std.dev.: 0.0015)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 2.10% (1.4792 => 1.5102, std.dev.: 0.0065)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.88% (4.5883 => 4.6746, std.dev.: 0.0225)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.43% (44.2807 => 44.9144, std.dev.: 0.0898)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.41% (1.4033 => 1.4231, std.dev.: 0.0023)
  MultiSource/Applications/minisat/minisat: 1.40% (0.7439 => 0.7543, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.35% (1.3365 => 1.3546, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.24% (1.2086 => 1.2236, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 61.00% (7.6426 => 12.3044, std.dev.: 0.0441)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.30% (2.8554 => 4.2632, std.dev.: 0.0140)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 24.56% (1.1431 => 1.4239, std.dev.: 0.0396)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 18.99% (6.4425 => 7.6658, std.dev.: 0.1102)
  SingleSource/Benchmarks/Shootout/matrix: 18.11% (1.7809 => 2.1035, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.82% (3.5550 => 3.8687, std.dev.: 0.0041)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.11% (1.2516 => 1.3531, std.dev.: 0.0052)
  MultiSource/Benchmarks/PAQ8p/paq8p: 7.35% (96.7834 => 103.8959, std.dev.: 1.9784)
  SingleSource/UnitTests/Vector/multiplies: 6.58% (0.5561 => 0.5927, std.dev.: 0.0000)
  MultiSource/Applications/spiff/spiff: 6.33% (2.8194 => 2.9979, std.dev.: 0.0159)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.61% (5.3716 => 5.6730, std.dev.: 0.0014)
  MultiSource/Applications/aha/aha: 5.56% (3.5731 => 3.7716, std.dev.: 0.0106)
  MultiSource/Applications/hexxagon/hexxagon: 5.39% (14.7810 => 15.5782, std.dev.: 0.0928)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.13% (3.1730 => 3.3358, std.dev.: 0.0234)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.35% (3.5642 => 3.7194, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.23% (4.4696 => 4.6141, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.16% (4.0181 => 4.1449, std.dev.: 0.0072)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.13% (89.7126 => 92.5232, std.dev.: 0.4228)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.04% (2.1472 => 2.2124, std.dev.: 0.0002)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.92% (2.5368 => 2.6109, std.dev.: 0.0089)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.79% (1.5940 => 1.6385, std.dev.: 0.0080)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.71% (0.3836 => 0.3940, std.dev.: 0.0027)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.41% (1.7652 => 1.8077, std.dev.: 0.0035)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.32% (1.8519 => 1.8949, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.30% (5.4925 => 5.6191, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.08% (1.0477 => 1.0695, std.dev.: 0.0004)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (2.4920 => 2.5421, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.01% (3.1569 => 3.2203, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.93% (5.3022 => 5.4045, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/lists: 1.92% (7.3703 => 7.5120, std.dev.: 0.0300)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.89% (3.5683 => 3.6358, std.dev.: 0.0081)
  SingleSource/Benchmarks/Shootout/fib2: 1.65% (3.5966 => 3.6558, std.dev.: 0.0041)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.44% (1.6707 => 1.6947, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.25% (6.6028 => 6.6856, std.dev.: 0.0101)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.25% (16.7972 => 17.0077, std.dev.: 0.0179)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.05% (4.9459 => 4.9979, std.dev.: 0.0112)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.04% (0.1483 => 0.1171, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.00% (0.2571 => 0.2391, std.dev.: 0.0029)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.70% (0.2193 => 0.2090, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.58% (1.2499 => 1.2302, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.16% (1.3068 => 1.2916, std.dev.: 0.0008)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.90% (0.5226 => 0.2357, std.dev.: 0.0685)
  MultiSource/Applications/sgefa/sgefa: -42.65% (1.5790 => 0.9055, std.dev.: 0.0047)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -35.00% (0.0400 => 0.0260, std.dev.: 0.0005)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.20% (57.2347 => 43.9565, std.dev.: 3.7547)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.07% (15.9508 => 12.9097, std.dev.: 0.0905)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.95% (50.0284 => 40.5499, std.dev.: 0.0476)
  SingleSource/Benchmarks/Shootout/heapsort: -18.16% (3.5900 => 2.9381, std.dev.: 0.1430)
  MultiSource/Benchmarks/FreeBench/mason/mason: -17.98% (0.3304 => 0.2710, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/moments: -15.88% (0.1285 => 0.1081, std.dev.: 0.0020)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.46% (3.4956 => 3.1299, std.dev.: 0.0270)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.17% (20.8247 => 18.7066, std.dev.: 0.0244)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.41% (8.1346 => 7.6131, std.dev.: 0.0819)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.43% (0.3501 => 0.3311, std.dev.: 0.0063)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.37% (30.1838 => 28.5625, std.dev.: 0.3921)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.41% (0.3462 => 0.3344, std.dev.: 0.0009)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.01% (3.7874 => 3.6733, std.dev.: 0.0081)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.88% (2.5938 => 2.5192, std.dev.: 0.0063)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.50% (2.3084 => 2.2506, std.dev.: 0.0220)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.13% (17.1431 => 16.7776, std.dev.: 0.0061)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.03% (4.3592 => 4.2708, std.dev.: 0.0185)
  SingleSource/Benchmarks/Misc/oourafft: -1.95% (3.7484 => 3.6752, std.dev.: 0.0244)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.38% (4.9022 => 4.8345, std.dev.: 0.0234)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.4471 => 2.4179, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.18% (1.4898 => 1.4722, std.dev.: 0.0012)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.85% (0.1348 => 0.1373, std.dev.: 0.0237)

Report Time: 0.88s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131028/90ffeb0c/attachment.html>


More information about the llvm-testresults mailing list