[llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Jan 25 04:29:41 PST 2014


http://llvm.org/perf/db_default/v4/nts/21286?compare_to=21274&baseline=19899
Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35

Comparing:
     Run: 21286, Order: 200071, Start Time: 2014-01-25 07:46:25, End Time: 2014-01-25 12:34:42
      To: 21274, Order: 200064, Start Time: 2014-01-25 02:52:23, End Time: 2014-01-25 07:42:02
Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02

===============
Tests Summary
===============

Performance Regressions: 8 (12 on baseline)
Performance Improvements: 3 (26 on baseline)
Unchanged Tests: 1099 (1072 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/pi: 500.00% (0.0040 => 0.0240, std.dev.: 0.0038)
  SingleSource/UnitTests/Threads/2010-12-08-tls: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout/random: 71.43% (0.0280 => 0.0480, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/ffbench: 19.05% (0.0840 => 0.1000, std.dev.: 0.0057)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.29% (0.0840 => 0.0960, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout-C++/hash: 7.27% (0.4400 => 0.4720, std.dev.: 0.0093)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0049)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.10% (5.0763 => 5.1323, std.dev.: 0.0143)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -3.54% (1.3561 => 1.3081, std.dev.: 0.0114)
  MultiSource/Applications/d/make_dparser: -1.57% (4.0801 => 4.0161, std.dev.: 0.0234)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.55% (11.3883 => 11.2123, std.dev.: 0.0451)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/mandel-2: 100.00% (0.0200 => 0.0400, std.dev.: 0.0051)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 33.33% (0.0480 => 0.0640, std.dev.: 0.0040)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.29% (0.0840 => 0.0960, std.dev.: 0.0042)
  SingleSource/Benchmarks/SmallPT/smallpt: 8.82% (0.1360 => 0.1480, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0066)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.51% (9.5802 => 9.8202, std.dev.: 0.0334)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.14% (1.0521 => 1.0641, std.dev.: 0.0045)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.23% (3.9842 => 4.2323, std.dev.: 0.0098)
  MultiSource/Applications/aha/aha: 1.53% (2.8802 => 2.9242, std.dev.: 0.0020)
  MultiSource/Applications/JM/lencod/lencod: 1.43% (8.1245 => 8.2405, std.dev.: 0.0413)
  SingleSource/Benchmarks/McGill/chomp: 1.30% (0.9241 => 0.9361, std.dev.: 0.0030)
  MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0049)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045)
  MultiSource/Benchmarks/nbench/nbench: -3.25% (1.3521 => 1.3081, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.93% (1.2281 => 1.1921, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.88% (1.2521 => 1.2161, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.58% (1.2401 => 1.2081, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.56% (1.2521 => 1.2201, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.46% (1.1361 => 1.1081, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.46% (1.3001 => 1.2681, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.43% (1.1521 => 1.1241, std.dev.: 0.0080)
  MultiSource/Applications/lemon/lemon: -2.39% (1.5041 => 1.4681, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.30% (1.2161 => 1.1881, std.dev.: 0.0108)
  MultiSource/Applications/d/make_dparser: -2.24% (4.1081 => 4.0161, std.dev.: 0.0234)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.18% (1.2841 => 1.2561, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.17% (1.2921 => 1.2641, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.02% (1.3841 => 1.3561, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.00% (1.2001 => 1.1761, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.86% (1.2881 => 1.2641, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.75% (1.1441 => 1.1241, std.dev.: 0.0069)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (11.3843 => 11.2123, std.dev.: 0.0451)
  MultiSource/Applications/SPASS/SPASS: -1.17% (18.7966 => 18.5764, std.dev.: 0.0420)
  MultiSource/Applications/oggenc/oggenc: -1.15% (6.2844 => 6.2124, std.dev.: 0.0243)
  MultiSource/Applications/ClamAV/clamscan: -1.14% (19.2243 => 19.0043, std.dev.: 0.0310)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.05% (3.0402 => 3.0082, std.dev.: 0.0113)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.55% (1.2401 => 1.1961, std.dev.: 0.0113)
  SingleSource/Benchmarks/Linpack/linpack-pc: -2.44% (7.8605 => 7.6685, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (4.8003 => 4.7443, std.dev.: 0.0191)

Report Time: 2.01s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140125/34a904bd/attachment.html>


More information about the llvm-testresults mailing list