[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 21 06:02:34 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16533?compare_to=16529&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16533, Order: 193073, Start Time: 2013-10-21 11:09:28, End Time: 2013-10-21 13:05:51
      To: 16529, Order: 193071, Start Time: 2013-10-21 09:03:28, End Time: 2013-10-21 10:47:15
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 24 (31 on baseline)
Performance Improvements: 8 (17 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1075 (1059 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 26.66% (0.2404 => 0.3045, std.dev.: 0.0111)
  MultiSource/Applications/JM/ldecod/ldecod: 26.40% (7.7361 => 9.7787, std.dev.: 0.3845)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 24.44% (4.9986 => 6.2203, std.dev.: 0.3021)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.73% (1.4267 => 1.6939, std.dev.: 0.0607)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 16.30% (44.9704 => 52.3028, std.dev.: 1.9429)
  MultiSource/Applications/lemon/lemon: 15.45% (1.2307 => 1.4209, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.40% (1.2309 => 1.4082, std.dev.: 0.0488)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 12.09% (1.2892 => 1.4451, std.dev.: 0.0249)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.2348 => 1.3783, std.dev.: 0.0239)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.19% (1.3351 => 1.4311, std.dev.: 0.0274)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.51% (1.3370 => 1.4241, std.dev.: 0.0251)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: 38.19% (1.3031 => 1.8008, std.dev.: 0.1596)
  MultiSource/Benchmarks/Olden/bisort/bisort: 38.09% (0.6686 => 0.9233, std.dev.: 0.0649)
  MultiSource/Applications/minisat/minisat: 29.94% (6.3465 => 8.2467, std.dev.: 0.6515)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.74% (1.3057 => 1.5504, std.dev.: 0.0491)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 17.58% (9.3157 => 10.9535, std.dev.: 0.4362)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.87% (2.2718 => 2.5642, std.dev.: 0.0667)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 10.49% (2.9143 => 3.2201, std.dev.: 0.1164)
  MultiSource/Benchmarks/mafft/pairlocalalign: 9.94% (40.8314 => 44.8908, std.dev.: 0.9916)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.47% (3.9758 => 4.2726, std.dev.: 0.0499)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.12% (6.2451 => 6.6896, std.dev.: 0.0600)
  SingleSource/Benchmarks/Shootout-C++/lists: 5.00% (15.8992 => 16.6949, std.dev.: 0.2091)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.55% (0.3831 => 0.3967, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.37% (4.8599 => 4.9752, std.dev.: 0.0344)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: -15.72% (5.4501 => 4.5931, std.dev.: 0.0797)
  SingleSource/Benchmarks/Shootout/sieve: -15.68% (8.4929 => 7.1611, std.dev.: 0.3994)
  SingleSource/Benchmarks/Stanford/Puzzle: -8.87% (0.1871 => 0.1705, std.dev.: 0.0060)
  MultiSource/Applications/spiff/spiff: -5.52% (2.9890 => 2.8240, std.dev.: 0.0574)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.32% (3.7208 => 3.5602, std.dev.: 0.0187)
  SingleSource/Benchmarks/Shootout/lists: -2.98% (7.4182 => 7.1974, std.dev.: 0.0803)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.87% (1.8438 => 1.7908, std.dev.: 0.0135)
  SingleSource/Benchmarks/Shootout-C++/methcall: -1.23% (12.6437 => 12.4877, std.dev.: 0.0414)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.06% (0.1409 => 0.1380, std.dev.: 0.0319)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/JM/ldecod/ldecod: 32.10% (7.4026 => 9.7787, std.dev.: 0.3845)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 30.41% (0.2335 => 0.3045, std.dev.: 0.0111)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 26.19% (4.9293 => 6.2203, std.dev.: 0.3021)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 20.64% (1.4041 => 1.6939, std.dev.: 0.0607)
  MultiSource/Applications/lemon/lemon: 19.79% (1.1862 => 1.4209, std.dev.: 0.0180)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 18.12% (44.2807 => 52.3028, std.dev.: 1.9429)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.29% (0.0700 => 0.0814, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.96% (1.2250 => 1.4082, std.dev.: 0.0488)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.04% (1.2086 => 1.3783, std.dev.: 0.0239)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.83% (1.2695 => 1.4451, std.dev.: 0.0249)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.41% (1.2523 => 1.3952, std.dev.: 0.0528)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.07% (1.3514 => 1.4875, std.dev.: 0.0510)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.13% (1.3235 => 1.4311, std.dev.: 0.0274)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.49% (1.3249 => 1.4241, std.dev.: 0.0251)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.40% (7.6426 => 12.4877, std.dev.: 0.0414)
  MultiSource/Benchmarks/Olden/bisort/bisort: 38.90% (0.6647 => 0.9233, std.dev.: 0.0649)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 37.02% (1.3143 => 1.8008, std.dev.: 0.1596)
  MultiSource/Applications/minisat/minisat: 31.40% (6.2760 => 8.2467, std.dev.: 0.6515)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 24.81% (1.1431 => 1.4267, std.dev.: 0.0395)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.19% (1.3008 => 1.5504, std.dev.: 0.0491)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 17.51% (6.4425 => 7.5709, std.dev.: 0.0903)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 15.80% (9.4586 => 10.9535, std.dev.: 0.4362)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 11.08% (2.3084 => 2.5642, std.dev.: 0.0667)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.20% (3.9856 => 4.2726, std.dev.: 0.0499)
  SingleSource/UnitTests/Vector/multiplies: 6.76% (0.5561 => 0.5937, std.dev.: 0.0125)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (3.1730 => 3.3488, std.dev.: 0.0148)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.42% (0.3836 => 0.3967, std.dev.: 0.0012)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.30% (89.7126 => 92.6719, std.dev.: 0.0411)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.70% (16.7972 => 17.0824, std.dev.: 0.0864)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (2.4920 => 2.5330, std.dev.: 0.0144)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.39% (8.1346 => 8.2479, std.dev.: 0.0274)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -56.36% (57.2347 => 24.9800, std.dev.: 12.3244)
  MultiSource/Benchmarks/FreeBench/neural/neural: -56.01% (0.5226 => 0.2299, std.dev.: 0.0840)
  MultiSource/Applications/sgefa/sgefa: -42.36% (1.5790 => 0.9101, std.dev.: 0.0111)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.97% (15.9508 => 13.4036, std.dev.: 0.2839)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.61% (20.8247 => 18.4063, std.dev.: 0.1922)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.49% (3.4956 => 3.1289, std.dev.: 0.0285)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.27% (50.0284 => 44.8908, std.dev.: 0.9916)
  MultiSource/Applications/JM/lencod/lencod: -9.66% (8.1785 => 7.3883, std.dev.: 0.2392)
  MultiSource/Benchmarks/Olden/em3d/em3d: -8.66% (5.0288 => 4.5931, std.dev.: 0.0797)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.84% (3.0561 => 2.8777, std.dev.: 0.0394)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.08% (2.5938 => 2.4879, std.dev.: 0.0227)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.30% (1.8519 => 1.7908, std.dev.: 0.0135)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.79% (3.7874 => 3.6817, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.77% (17.1431 => 16.6683, std.dev.: 0.0711)
  SingleSource/Benchmarks/Misc/oourafft: -1.76% (3.7484 => 3.6823, std.dev.: 0.0223)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.52% (4.3592 => 4.2931, std.dev.: 0.0066)
  SingleSource/Benchmarks/Misc/whetstone: -1.07% (3.6303 => 3.5913, std.dev.: 0.0104)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.37% (0.1348 => 0.1380, std.dev.: 0.0319)

Report Time: 0.94s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131021/56e01eb5/attachment.html>


More information about the llvm-testresults mailing list