[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Sep 13 08:32:54 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15261?compare_to=15258&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15261, Order: 190689, Start Time: 2013-09-13 13:43:23, End Time: 2013-09-13 15:35:26
      To: 15258, Order: 190677, Start Time: 2013-09-13 11:27:17, End Time: 2013-09-13 13:19:03
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 27 (39 on baseline)
Performance Improvements: 11 (7 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1069 (1061 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 59.44% (0.0355 => 0.0566, std.dev.: 0.0040)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 53.45% (0.0391 => 0.0600, std.dev.: 0.0033)
  MultiSource/Benchmarks/Bullet/bullet: 17.43% (34.2873 => 40.2644, std.dev.: 0.8957)
  MultiSource/Benchmarks/mafft/pairlocalalign: 12.20% (10.8519 => 12.1762, std.dev.: 0.2593)
  MultiSource/Applications/aha/aha: 11.55% (0.1299 => 0.1449, std.dev.: 0.0007)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.85% (0.8285 => 0.9018, std.dev.: 0.0170)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.29% (4.3083 => 4.6224, std.dev.: 0.0199)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.76% (2.8652 => 3.0589, std.dev.: 0.0325)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.95% (26.9473 => 28.5498, std.dev.: 0.4397)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: 20.22% (7.0645 => 8.4927, std.dev.: 0.0074)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 15.00% (9.8362 => 11.3112, std.dev.: 0.0597)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 12.06% (22.2091 => 24.8869, std.dev.: 0.6438)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 10.66% (2.1846 => 2.4174, std.dev.: 0.0132)
  SingleSource/Benchmarks/Stanford/Puzzle: 8.71% (0.1722 => 0.1872, std.dev.: 0.0025)
  MultiSource/Applications/JM/lencod/lencod: 7.23% (7.6984 => 8.2553, std.dev.: 0.0642)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.14% (3.6460 => 3.8699, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.07% (2.7039 => 2.8409, std.dev.: 0.0153)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.77% (3.9973 => 4.1880, std.dev.: 0.0334)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.79% (0.3085 => 0.3202, std.dev.: 0.0029)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.43% (8.1374 => 8.4165, std.dev.: 0.0134)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.89% (1.1187 => 1.1510, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.77% (4.4656 => 4.5891, std.dev.: 0.0189)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 2.52% (2.4585 => 2.5204, std.dev.: 0.0058)
  SingleSource/Benchmarks/Misc/flops: 1.91% (9.3842 => 9.5633, std.dev.: 0.0665)
  SingleSource/Regression/C/uint64_to_float: 1.82% (1.4588 => 1.4854, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.45% (6.5988 => 6.6946, std.dev.: 0.0296)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.05% (4.9404 => 4.9925, std.dev.: 0.0020)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except: -42.33% (0.3572 => 0.2060, std.dev.: 0.0095)
  SingleSource/UnitTests/2002-08-19-CodegenBug: -40.19% (0.0321 => 0.0192, std.dev.: 0.0020)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -22.40% (0.1946 => 0.1510, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -19.71% (0.2456 => 0.1972, std.dev.: 0.0174)
  MultiSource/Applications/d/make_dparser: -11.14% (4.1036 => 3.6464, std.dev.: 0.1554)
  MultiSource/Applications/siod/siod: -7.75% (2.9458 => 2.7175, std.dev.: 0.0426)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/d/make_dparser: -39.59% (0.0639 => 0.0386, std.dev.: 0.0015)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.92% (4.5280 => 4.0787, std.dev.: 0.1441)
  SingleSource/Benchmarks/Shootout/nestedloop: -8.80% (0.1716 => 0.1565, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -6.17% (0.5028 => 0.4718, std.dev.: 0.0060)
  MultiSource/Applications/aha/aha: -1.97% (3.6623 => 3.5900, std.dev.: 0.0022)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.02% (0.1393 => 0.1351, std.dev.: 0.0131)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 68.96% (0.0335 => 0.0566, std.dev.: 0.0040)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 61.29% (0.0372 => 0.0600, std.dev.: 0.0033)
  MultiSource/Benchmarks/Bullet/bullet: 22.93% (32.7552 => 40.2644, std.dev.: 0.8957)
  MultiSource/Benchmarks/mafft/pairlocalalign: 21.88% (9.9903 => 12.1762, std.dev.: 0.2593)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 17.50% (44.2807 => 52.0311, std.dev.: 2.7213)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.99% (24.6139 => 28.5498, std.dev.: 0.4397)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 15.47% (2.6492 => 3.0589, std.dev.: 0.0325)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.42% (4.0397 => 4.6224, std.dev.: 0.0199)
  MultiSource/Applications/aha/aha: 13.29% (0.1279 => 0.1449, std.dev.: 0.0007)
  MultiSource/Applications/siod/siod: 11.01% (2.4480 => 2.7175, std.dev.: 0.0426)
  MultiSource/Applications/sgefa/sgefa: 10.94% (0.3848 => 0.4269, std.dev.: 0.0128)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.53% (0.8233 => 0.9018, std.dev.: 0.0170)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.49% (0.5046 => 0.5525, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.29% (1.3235 => 1.3935, std.dev.: 0.0243)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/7zip/7zip-benchmark: 19.59% (9.4586 => 11.3112, std.dev.: 0.0597)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.56% (0.1374 => 0.1629, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/sieve: 17.54% (7.2254 => 8.4927, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.64% (21.5217 => 24.8869, std.dev.: 0.6438)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.58% (40.5588 => 46.4738, std.dev.: 1.6945)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.51% (2.1111 => 2.4174, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.86% (3.5550 => 3.8699, std.dev.: 0.0024)
  MultiSource/Applications/sgefa/sgefa: 8.33% (1.5790 => 1.7105, std.dev.: 0.0056)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 7.87% (2.3365 => 2.5204, std.dev.: 0.0058)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.89% (2.6579 => 2.8409, std.dev.: 0.0153)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0003)
  MultiSource/Applications/spiff/spiff: 5.66% (2.8194 => 2.9791, std.dev.: 0.0611)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 5.52% (3.9691 => 4.1880, std.dev.: 0.0334)
  SingleSource/Benchmarks/McGill/misr: 5.12% (0.3771 => 0.3964, std.dev.: 0.0002)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 4.77% (20.8247 => 21.8174, std.dev.: 0.1338)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 4.51% (1.1013 => 1.1510, std.dev.: 0.0121)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.47% (8.1346 => 8.4165, std.dev.: 0.0134)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.11% (5.3716 => 5.5385, std.dev.: 0.0591)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.67% (4.4696 => 4.5891, std.dev.: 0.0189)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (1.7652 => 1.8058, std.dev.: 0.0128)
  SingleSource/Regression/C/uint64_to_float: 2.24% (1.4528 => 1.4854, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.94% (5.3022 => 5.4051, std.dev.: 0.0033)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.59% (16.7972 => 17.0641, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.47% (5.0196 => 5.0934, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.39% (6.6028 => 6.6946, std.dev.: 0.0296)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: -8.95% (0.1195 => 0.1088, std.dev.: 0.0034)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -16.67% (57.2347 => 47.6910, std.dev.: 2.6359)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.94% (3.7437 => 3.4091, std.dev.: 0.1085)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.27% (50.0284 => 46.8927, std.dev.: 0.2361)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.64% (17.1431 => 16.6902, std.dev.: 0.1702)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.41% (2.5938 => 2.5314, std.dev.: 0.0204)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.19% (89.7126 => 88.6443, std.dev.: 0.2687)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.22% (0.1348 => 0.1351, std.dev.: 0.0131)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130913/decee2f0/attachment.html>


More information about the llvm-testresults mailing list