[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Sep 27 04:23:33 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15722?compare_to=15719&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15722, Order: 191494, Start Time: 2013-09-27 09:32:21, End Time: 2013-09-27 11:26:21
      To: 15719, Order: 191486, Start Time: 2013-09-27 07:19:24, End Time: 2013-09-27 09:11:06
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 31 (44 on baseline)
Performance Improvements: 10 (13 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1050 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-6: 74.78% (0.0337 => 0.0589, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 54.93% (0.0812 => 0.1258, std.dev.: 0.0081)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 16.09% (45.1758 => 52.4433, std.dev.: 1.3944)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.20% (25.0856 => 28.8996, std.dev.: 0.1278)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.43% (1.2976 => 1.4719, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.18% (1.3106 => 1.4834, std.dev.: 0.0640)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.94% (1.2317 => 1.3665, std.dev.: 0.0159)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.59% (1.3601 => 1.5042, std.dev.: 0.0441)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.78% (0.5169 => 0.5623, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.17% (1.3373 => 1.4465, std.dev.: 0.0311)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.79% (6.4305 => 6.9317, std.dev.: 0.0639)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.77% (4.3104 => 4.6455, std.dev.: 0.0373)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 19.36% (3.0892 => 3.6874, std.dev.: 0.2044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 15.62% (40.6213 => 46.9652, std.dev.: 1.1369)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.15% (2.1138 => 2.4128, std.dev.: 0.0258)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 12.94% (2.3006 => 2.5984, std.dev.: 0.0114)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 11.01% (0.4568 => 0.5071, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.40% (4.9599 => 5.4756, std.dev.: 0.0495)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 9.78% (2.6537 => 2.9132, std.dev.: 0.0235)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 9.58% (2.9234 => 3.2034, std.dev.: 0.0294)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.47% (5.9766 => 6.4232, std.dev.: 0.0297)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.32% (1.0744 => 1.1530, std.dev.: 0.0244)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.25% (2.8766 => 3.0564, std.dev.: 0.0125)
  SingleSource/Benchmarks/Misc/salsa20: 4.87% (7.7869 => 8.1663, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.18% (5.9414 => 6.1897, std.dev.: 0.0316)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.02% (5.4540 => 5.6735, std.dev.: 0.0187)
  MultiSource/Applications/hexxagon/hexxagon: 3.77% (15.1941 => 15.7662, std.dev.: 0.0120)
  SingleSource/Benchmarks/Misc/flops: 2.51% (9.3637 => 9.5988, std.dev.: 0.0127)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.86% (3.2003 => 3.2599, std.dev.: 0.0190)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.63% (1.2698 => 1.2905, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.06% (11.7220 => 11.8462, std.dev.: 0.0451)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/lua/lua: -18.54% (5.3437 => 4.3532, std.dev.: 0.1916)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -16.24% (0.0905 => 0.0758, std.dev.: 0.0024)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.25% (0.6713 => 0.5958, std.dev.: 0.0167)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -9.63% (0.1859 => 0.1680, std.dev.: 0.0058)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.80% (0.2474 => 0.2281, std.dev.: 0.0067)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -5.43% (0.2246 => 0.2124, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.74% (1.4317 => 1.3925, std.dev.: 0.0070)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -2.61% (0.3914 => 0.3812, std.dev.: 0.0033)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.06% (13.8207 => 13.2599, std.dev.: 0.1623)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.41% (5.1416 => 5.0691, std.dev.: 0.0262)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.22% (0.1366 => 0.1369, std.dev.: 0.0065)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-6: 86.98% (0.0315 => 0.0589, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 66.40% (0.0756 => 0.1258, std.dev.: 0.0081)
  SingleSource/Benchmarks/Misc/salsa20: 56.71% (0.0529 => 0.0829, std.dev.: 0.0111)
  MultiSource/Benchmarks/Bullet/bullet: 19.89% (32.7552 => 39.2686, std.dev.: 2.3505)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 18.43% (44.2807 => 52.4433, std.dev.: 1.3944)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 17.41% (24.6139 => 28.8996, std.dev.: 0.1278)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 16.90% (2.6492 => 3.0969, std.dev.: 0.1212)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.00% (4.0397 => 4.6455, std.dev.: 0.0373)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 14.98% (6.0284 => 6.9317, std.dev.: 0.0639)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.57% (1.2948 => 1.4834, std.dev.: 0.0640)
  MultiSource/Applications/ClamAV/clamscan: 12.86% (16.5398 => 18.6675, std.dev.: 0.4518)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 12.86% (1.3042 => 1.4719, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 12.00% (1.2201 => 1.3665, std.dev.: 0.0159)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.43% (0.5046 => 0.5623, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.43% (1.3499 => 1.5042, std.dev.: 0.0441)
  SingleSource/Benchmarks/McGill/exptree: 11.40% (0.0947 => 0.1055, std.dev.: 0.0034)
  MultiSource/Applications/oggenc/oggenc: 10.67% (5.3339 => 5.9030, std.dev.: 0.0638)
  SingleSource/Benchmarks/McGill/chomp: 10.22% (0.2202 => 0.2427, std.dev.: 0.0017)
  MultiSource/Applications/JM/lencod/lencod: 9.91% (16.5902 => 18.2349, std.dev.: 0.5982)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.18% (1.3249 => 1.4465, std.dev.: 0.0311)
  MultiSource/Applications/JM/ldecod/ldecod: 7.62% (7.4026 => 7.9668, std.dev.: 0.1857)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.19% (1.3365 => 1.3925, std.dev.: 0.0070)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 2.83% (0.3707 => 0.3812, std.dev.: 0.0033)
  MultiSource/Applications/minisat/minisat: 2.14% (0.7439 => 0.7598, std.dev.: 0.0046)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.84% (7.6426 => 12.5214, std.dev.: 0.0118)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 16.00% (21.5217 => 24.9647, std.dev.: 0.7999)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 15.80% (40.5588 => 46.9652, std.dev.: 1.1369)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.29% (2.1111 => 2.4128, std.dev.: 0.0258)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 11.21% (2.3365 => 2.5984, std.dev.: 0.0114)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.78% (4.9428 => 5.4756, std.dev.: 0.0495)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 9.61% (2.6579 => 2.9132, std.dev.: 0.0235)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 9.06% (2.9372 => 3.2034, std.dev.: 0.0294)
  MultiSource/Applications/hexxagon/hexxagon: 6.67% (14.7810 => 15.7662, std.dev.: 0.0120)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0023)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.32% (8.1346 => 8.6491, std.dev.: 0.0217)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.62% (5.3716 => 5.6735, std.dev.: 0.0187)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.15% (6.1088 => 6.4232, std.dev.: 0.0297)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.80% (5.9061 => 6.1897, std.dev.: 0.0316)
  SingleSource/Benchmarks/Misc/salsa20: 4.74% (7.7964 => 8.1663, std.dev.: 0.0047)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (3.1730 => 3.2599, std.dev.: 0.0190)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.30% (1.5940 => 1.6306, std.dev.: 0.0043)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.71% (1.7652 => 1.7953, std.dev.: 0.0092)
  SingleSource/Benchmarks/Misc/flops: 1.65% (9.4433 => 9.5988, std.dev.: 0.0127)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.03% (1.1923 => 1.2046, std.dev.: 0.0023)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.11% (0.5226 => 0.2398, std.dev.: 0.0454)
  MultiSource/Applications/sgefa/sgefa: -47.00% (1.5790 => 0.8368, std.dev.: 0.0108)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.68% (57.2347 => 43.6814, std.dev.: 2.4273)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.87% (15.9508 => 13.2599, std.dev.: 0.1623)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.14% (20.8247 => 18.5058, std.dev.: 0.0505)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.17% (3.4956 => 3.1402, std.dev.: 0.0331)
  MultiSource/Applications/JM/lencod/lencod: -8.72% (8.1785 => 7.4657, std.dev.: 0.1783)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.03% (50.0284 => 46.0123, std.dev.: 0.3791)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.77% (4.3592 => 4.1949, std.dev.: 0.0496)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.82% (17.1431 => 16.6601, std.dev.: 0.0861)
  SingleSource/Benchmarks/Shootout/lists: -2.48% (7.3703 => 7.1875, std.dev.: 0.0440)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.29% (5.2422 => 5.1222, std.dev.: 0.0377)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.22% (89.7126 => 88.6147, std.dev.: 0.1430)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.56% (0.1348 => 0.1369, std.dev.: 0.0065)

Report Time: 0.65s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130927/10dae75e/attachment.html>


More information about the llvm-testresults mailing list