[llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jan 20 10:09:34 PST 2014


http://llvm.org/perf/db_default/v4/nts/20899?compare_to=20879&baseline=19899
Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35

Comparing:
     Run: 20899, Order: 199654, Start Time: 2014-01-20 13:26:39, End Time: 2014-01-20 18:14:29
      To: 20879, Order: 199629, Start Time: 2014-01-20 08:23:13, End Time: 2014-01-20 13:10:49
Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02

===============
Tests Summary
===============

Performance Regressions: 10 (29 on baseline)
Performance Improvements: 6 (1 on baseline)
Unchanged Tests: 1094 (1080 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038)
  SingleSource/UnitTests/2006-02-04-DivRem: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/flops-5: 66.67% (0.0240 => 0.0400, std.dev.: 0.0047)
  SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 11.54% (0.1040 => 0.1160, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.00% (0.2400 => 0.2520, std.dev.: 0.0043)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: 44.44% (0.0360 => 0.0520, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.46% (0.2960 => 0.3240, std.dev.: 0.0103)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.69% (0.3640 => 0.3920, std.dev.: 0.0054)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.27% (1.2361 => 1.2081, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.17% (1.2921 => 1.2641, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.11% (1.3241 => 1.2961, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.91% (1.2561 => 1.2321, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.64% (1.2161 => 1.1961, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.63% (1.2241 => 1.2041, std.dev.: 0.0072)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2004-02-03-AggregateCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041)
  SingleSource/UnitTests/2002-05-03-NotTest: 200.00% (0.0080 => 0.0240, std.dev.: 0.0038)
  SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout/nestedloop: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030)
  MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 15.79% (0.0760 => 0.0880, std.dev.: 0.0028)
  MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1320 => 0.1520, std.dev.: 0.0076)
  MultiSource/Benchmarks/Olden/power/power: 13.16% (0.1520 => 0.1720, std.dev.: 0.0064)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.62% (0.2320 => 0.2520, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.88% (0.6800 => 0.7200, std.dev.: 0.0131)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 4.92% (0.2440 => 0.2560, std.dev.: 0.0040)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.84% (9.5802 => 9.9482, std.dev.: 0.0494)
  MultiSource/Applications/hexxagon/hexxagon: 3.48% (1.1480 => 1.1880, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.11% (1.1561 => 1.1921, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.03% (1.1841 => 1.2081, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.75% (1.3681 => 1.3921, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.72% (2.0920 => 2.1280, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.70% (1.1761 => 1.1961, std.dev.: 0.0072)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.54% (11.4440 => 11.6200, std.dev.: 0.0674)
  MultiSource/Applications/JM/lencod/lencod: 1.43% (19.5406 => 19.8206, std.dev.: 0.0393)
  MultiSource/Applications/oggenc/oggenc: 1.34% (6.2844 => 6.3684, std.dev.: 0.0163)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.18% (3.0402 => 3.0762, std.dev.: 0.0080)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.05% (11.3843 => 11.5043, std.dev.: 0.0400)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 5.38% (0.3720 => 0.3920, std.dev.: 0.0054)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.32% (3.9842 => 4.1963, std.dev.: 0.0184)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.82% (0.3320 => 0.3480, std.dev.: 0.0056)
  MultiSource/Benchmarks/Olden/bisort/bisort: 1.65% (0.7280 => 0.7400, std.dev.: 0.0037)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.87% (1.2401 => 1.1921, std.dev.: 0.0184)

Report Time: 1.92s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140120/b56afb74/attachment.html>


More information about the llvm-testresults mailing list