[llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jan 14 00:22:51 PST 2014


http://llvm.org/perf/db_default/v4/nts/20483?compare_to=20463&baseline=19899
Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35

Comparing:
     Run: 20483, Order: 199177, Start Time: 2014-01-14 03:40:06, End Time: 2014-01-14 08:27:37
      To: 20463, Order: 199157, Start Time: 2014-01-13 22:42:35, End Time: 2014-01-14 03:30:57
Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02

===============
Tests Summary
===============

Performance Regressions: 23 (25 on baseline)
Unchanged Tests: 1087 (1085 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2009-12-07-StructReturn: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032)
  SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035)
  SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030)
  SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037)
  SingleSource/UnitTests/conditional-gnu-ext-cxx: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 36.36% (0.0440 => 0.0600, std.dev.: 0.0035)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 33.33% (0.0480 => 0.0640, std.dev.: 0.0045)
  SingleSource/Regression/C/uint64_to_float: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 8.33% (0.2400 => 0.2600, std.dev.: 0.0070)
  SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/lists: 6.94% (0.2880 => 0.3080, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2320 => 0.2480, std.dev.: 0.0051)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0059)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.33% (0.3160 => 0.3360, std.dev.: 0.0067)
  SingleSource/Benchmarks/Shootout-C++/sieve: 6.17% (0.3240 => 0.3440, std.dev.: 0.0067)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.94% (0.3240 => 0.3400, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.97% (1.1081 => 1.1521, std.dev.: 0.0059)
  MultiSource/Applications/hexxagon/hexxagon: 3.15% (1.1440 => 1.1800, std.dev.: 0.0107)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/strcat: 30.77% (0.0520 => 0.0680, std.dev.: 0.0060)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 11.66% (0.6520 => 0.7280, std.dev.: 0.0261)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (0.1840 => 0.1960, std.dev.: 0.0036)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.44% (0.4920 => 0.5040, std.dev.: 0.0018)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035)
  SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030)
  SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037)
  SingleSource/UnitTests/Vector/divides: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
  SingleSource/UnitTests/conditional-gnu-ext-cxx: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042)
  SingleSource/Regression/C/uint64_to_float: 44.44% (0.0360 => 0.0520, std.dev.: 0.0041)
  MultiSource/Benchmarks/BitBench/five11/five11: 26.67% (0.0600 => 0.0760, std.dev.: 0.0047)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0069)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 15.79% (0.0760 => 0.0880, std.dev.: 0.0033)
  SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0060)
  MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0056)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.59% (0.3160 => 0.3400, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0057)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0037)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 5.26% (0.4560 => 0.4800, std.dev.: 0.0072)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.12% (0.6800 => 0.7080, std.dev.: 0.0101)
  SingleSource/Benchmarks/Linpack/linpack-pc: 3.85% (0.3120 => 0.3240, std.dev.: 0.0045)
  MultiSource/Applications/hexxagon/hexxagon: 2.79% (1.1480 => 1.1800, std.dev.: 0.0107)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.76% (9.5802 => 9.8442, std.dev.: 0.0609)
  MultiSource/Applications/obsequi/Obsequi: 2.59% (1.3920 => 1.4280, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.41% (1.1361 => 1.1521, std.dev.: 0.0059)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.3000 => 0.3320, std.dev.: 0.0076)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.23% (3.9842 => 4.2323, std.dev.: 0.0147)

Report Time: 3.14s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140114/e24d260d/attachment.html>


More information about the llvm-testresults mailing list