[llvm-testresults] pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jan 1 14:28:22 PST 2014


http://llvm.org/perf/db_default/v4/nts/19472?compare_to=19457&baseline=18571
Nickname: pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64:28

Comparing:
     Run: 19472, Order: 198279, Start Time: 2014-01-01 17:45:28, End Time: 2014-01-01 22:32:53
      To: 19457, Order: 198274, Start Time: 2014-01-01 12:40:01, End Time: 2014-01-01 17:27:36
Baseline: 18571, Order: 197553, Start Time: 2013-12-18 09:16:57, End Time: 2013-12-18 14:35:04

===============
Tests Summary
===============

Performance Regressions: 15 (23 on baseline)
Performance Improvements: 2 (9 on baseline)
Unchanged Tests: 1093 (1078 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/divides: 400.00% (0.0040 => 0.0200, std.dev.: 0.0033)
  SingleSource/UnitTests/2006-12-01-float_varg: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044)
  SingleSource/Regression/C/2003-05-22-VarSizeArray: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 50.00% (0.0320 => 0.0480, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 26.32% (0.0760 => 0.0960, std.dev.: 0.0059)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 16.33% (0.1960 => 0.2280, std.dev.: 0.0057)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.0840 => 0.0960, std.dev.: 0.0036)
  SingleSource/Benchmarks/Stanford/Puzzle: 13.79% (0.1160 => 0.1320, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/objinst: 12.73% (0.2200 => 0.2480, std.dev.: 0.0064)
  MultiSource/Benchmarks/McCat/18-imp/imp: 5.56% (0.4320 => 0.4560, std.dev.: 0.0082)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.57% (5.2960 => 5.4320, std.dev.: 0.0308)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.17% (0.7360 => 0.7520, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.63% (1.2241 => 1.2441, std.dev.: 0.0072)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.88% (1.0361 => 1.1281, std.dev.: 0.0321)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.14% (2.4642 => 2.4922, std.dev.: 0.0037)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/minisat/minisat: -2.78% (0.8640 => 0.8400, std.dev.: 0.0087)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.30% (2.7602 => 2.7242, std.dev.: 0.0084)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041)
  SingleSource/Regression/C/2003-05-22-VarSizeArray: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/flops-4: 100.00% (0.0200 => 0.0400, std.dev.: 0.0045)
  SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
  SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.00% (0.1000 => 0.1160, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0035)
  SingleSource/UnitTests/Vector/constpool: 8.29% (10.3246 => 11.1807, std.dev.: 0.1335)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.49% (0.3560 => 0.3720, std.dev.: 0.0058)
  MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (5.2320 => 5.4320, std.dev.: 0.0308)
  MultiSource/Applications/hbd/hbd: 3.76% (1.7040 => 1.7680, std.dev.: 0.0210)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.30% (0.7280 => 0.7520, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.21% (1.1201 => 1.1561, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.71% (1.1801 => 1.2121, std.dev.: 0.0074)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.54% (1.4160 => 1.4520, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.97% (1.2201 => 1.2441, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.58% (1.2641 => 1.2841, std.dev.: 0.0059)
  MultiSource/Applications/lemon/lemon: 1.35% (1.4801 => 1.5001, std.dev.: 0.0069)
  MultiSource/Applications/JM/lencod/lencod: 1.02% (19.2805 => 19.4766, std.dev.: 0.0513)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.01% (5.9164 => 5.9764, std.dev.: 0.0210)
  MultiSource/Benchmarks/Bullet/bullet: 1.01% (38.5246 => 38.9126, std.dev.: 0.0957)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.90% (1.0081 => 1.1281, std.dev.: 0.0321)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/flops-3: -40.00% (0.0400 => 0.0240, std.dev.: 0.0054)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -66.11% (97.4941 => 33.0421, std.dev.: 20.3467)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -66.10% (145.2571 => 49.2351, std.dev.: 30.7946)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -63.10% (46.2869 => 17.0811, std.dev.: 10.7293)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -28.85% (3.3282 => 2.3681, std.dev.: 0.1062)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -24.66% (38.3664 => 28.9058, std.dev.: 0.7067)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.41% (2.6842 => 2.5122, std.dev.: 0.0655)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.32% (6.5084 => 6.2924, std.dev.: 0.0698)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.82% (1.3201 => 1.2961, std.dev.: 0.0072)

Report Time: 2.99s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140101/518d59b9/attachment.html>


More information about the llvm-testresults mailing list