[llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results

Tue Jan 14 05:17:31 PST 2014

http://llvm.org/perf/db_default/v4/nts/20496?compare_to=20488&baseline=19898
Nickname: pollyperf-O3__clang_DEV__x86_64:34

Comparing:
     Run: 20496, Order: 199194, Start Time: 2014-01-14 08:37:47, End Time: 2014-01-14 13:22:20
      To: 20488, Order: 199180, Start Time: 2014-01-14 04:47:06, End Time: 2014-01-14 09:31:51
Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29

===============
Tests Summary
===============

Performance Regressions: 15 (33 on baseline)
Performance Improvements: 2 (4 on baseline)
Unchanged Tests: 1093 (1073 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-04-20-LoopBug2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044)
  SingleSource/UnitTests/2006-01-23-UnionInit: 133.33% (0.0120 => 0.0280, std.dev.: 0.0059)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 133.33% (0.0120 => 0.0280, std.dev.: 0.0041)
  SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031)
  SingleSource/Benchmarks/Stanford/Bubblesort: 66.67% (0.0240 => 0.0400, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/flops-5: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.54% (0.1040 => 0.1160, std.dev.: 0.0037)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.82% (0.2720 => 0.2960, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0061)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2200 => 0.2360, std.dev.: 0.0062)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.59% (0.7800 => 0.8080, std.dev.: 0.0067)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.46% (8.2241 => 8.3441, std.dev.: 0.0338)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.36% (1.1761 => 1.1921, std.dev.: 0.0056)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/hash: 5.69% (0.4920 => 0.5200, std.dev.: 0.0105)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/multiplies: -30.00% (0.0400 => 0.0280, std.dev.: 0.0036)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9282 => 3.8482, std.dev.: 0.0265)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045)
  SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0072)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0061)
  MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0077)
  SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0053)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.4400 => 0.4680, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.03% (1.1881 => 1.2241, std.dev.: 0.0117)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0068)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.4400 => 0.4520, std.dev.: 0.0045)
  MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7880 => 0.8080, std.dev.: 0.0067)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.53% (6.0160 => 6.1680, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.48% (1.1281 => 1.1561, std.dev.: 0.0090)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.46% (8.1441 => 8.3441, std.dev.: 0.0338)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.7120 => 0.7280, std.dev.: 0.0048)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.14% (5.8000 => 5.9240, std.dev.: 0.0386)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.14% (1.1241 => 1.1481, std.dev.: 0.0057)
  MultiSource/Applications/lua/lua: 1.95% (4.5200 => 4.6080, std.dev.: 0.0330)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.70% (1.1761 => 1.1961, std.dev.: 0.0054)
  MultiSource/Applications/JM/lencod/lencod: 1.68% (17.6165 => 17.9125, std.dev.: 0.0493)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.64% (1.2201 => 1.2401, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.53% (10.6960 => 10.8600, std.dev.: 0.0596)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.35% (1.1841 => 1.2001, std.dev.: 0.0062)
  MultiSource/Applications/siod/siod: 1.24% (2.5721 => 2.6041, std.dev.: 0.0088)
  MultiSource/Benchmarks/Bullet/bullet: 1.20% (37.0925 => 37.5365, std.dev.: 0.0668)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.19% (10.4082 => 10.5322, std.dev.: 0.0413)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.09% (48.1088 => 48.6328, std.dev.: 0.0937)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.53% (0.3040 => 0.3360, std.dev.: 0.0091)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.35% (2.3881 => 2.2841, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0265)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020)

Report Time: 2.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140114/b0c55cf9/attachment.html>