[llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Jan 19 19:07:58 PST 2014


http://llvm.org/perf/db_default/v4/nts/20847?compare_to=20834&baseline=19899
Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35

Comparing:
     Run: 20847, Order: 199612, Start Time: 2014-01-19 22:25:08, End Time: 2014-01-20 03:12:52
      To: 20834, Order: 199605, Start Time: 2014-01-19 17:21:13, End Time: 2014-01-19 22:09:17
Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02

===============
Tests Summary
===============

Performance Regressions: 11 (28 on baseline)
Performance Improvements: 0 (1 on baseline)
Unchanged Tests: 1099 (1081 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-04-20-LoopBug2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0028)
  SingleSource/Regression/C++/2003-06-08-VirtualFunctions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033)
  SingleSource/UnitTests/FloatPrecision: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036)
  MultiSource/Benchmarks/Olden/bisort/bisort: 40.00% (0.0600 => 0.0840, std.dev.: 0.0091)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.74% (0.0920 => 0.1120, std.dev.: 0.0074)
  MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.29% (0.7680 => 0.8240, std.dev.: 0.0181)
  SingleSource/Benchmarks/Shootout-C++/objinst: 6.90% (0.2320 => 0.2480, std.dev.: 0.0058)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.28% (0.2280 => 0.2560, std.dev.: 0.0038)
  MultiSource/Applications/lemon/lemon: 4.20% (0.9521 => 0.9921, std.dev.: 0.0141)
  MultiSource/Applications/obsequi/Obsequi: 2.12% (2.0721 => 2.1161, std.dev.: 0.0128)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-05-02-DependentPHI: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0160 => 0.0320, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/mandel-2: 100.00% (0.0200 => 0.0400, std.dev.: 0.0059)
  SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0045)
  MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0051)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0092)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.33% (0.3160 => 0.3360, std.dev.: 0.0066)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.29% (0.6800 => 0.7160, std.dev.: 0.0102)
  SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0053)
  MultiSource/Applications/hexxagon/hexxagon: 3.48% (1.1480 => 1.1880, std.dev.: 0.0132)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.26% (0.3680 => 0.3800, std.dev.: 0.0044)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.21% (9.5802 => 9.8882, std.dev.: 0.0479)
  MultiSource/Applications/minisat/minisat: 2.87% (0.8360 => 0.8600, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.08% (1.1561 => 1.1801, std.dev.: 0.0080)
  MultiSource/Benchmarks/nbench/nbench: 1.78% (1.3521 => 1.3761, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.71% (1.1721 => 1.1921, std.dev.: 0.0068)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.55% (5.6680 => 5.7560, std.dev.: 0.0301)
  MultiSource/Applications/oggenc/oggenc: 1.21% (6.2844 => 6.3604, std.dev.: 0.0212)
  MultiSource/Applications/lemon/lemon: 1.06% (1.5041 => 1.5201, std.dev.: 0.0061)
  MultiSource/Applications/SPASS/SPASS: 1.02% (18.7966 => 18.9886, std.dev.: 0.0441)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (11.3843 => 11.5003, std.dev.: 0.0255)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.47% (0.2360 => 0.2560, std.dev.: 0.0025)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 6.67% (0.2400 => 0.2560, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 6.45% (0.3720 => 0.3960, std.dev.: 0.0074)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.02% (0.3320 => 0.3520, std.dev.: 0.0059)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.52% (3.9842 => 4.2043, std.dev.: 0.0198)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.23% (1.2401 => 1.2001, std.dev.: 0.0089)

Report Time: 2.15s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140119/e657be9b/attachment.html>


More information about the llvm-testresults mailing list