[llvm-testresults] pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Jan 4 23:45:47 PST 2014


http://llvm.org/perf/db_default/v4/nts/19727?compare_to=19699&baseline=18571
Nickname: pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64:28

Comparing:
     Run: 19727, Order: 198534, Start Time: 2014-01-05 03:02:45, End Time: 2014-01-05 07:50:26
      To: 19699, Order: 198503, Start Time: 2014-01-04 21:57:33, End Time: 2014-01-05 02:44:52
Baseline: 18571, Order: 197553, Start Time: 2013-12-18 09:16:57, End Time: 2013-12-18 14:35:04

===============
Tests Summary
===============

Performance Regressions: 15 (39 on baseline)
Performance Improvements: 0 (7 on baseline)
Unchanged Tests: 1095 (1064 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-04-22-Switch: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045)
  SingleSource/Regression/C/casts: 66.67% (0.0240 => 0.0400, std.dev.: 0.0047)
  SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 17.39% (0.0920 => 0.1080, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045)
  SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.53% (0.1520 => 0.1680, std.dev.: 0.0059)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.03% (0.6200 => 0.6760, std.dev.: 0.0096)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.52% (0.7360 => 0.7840, std.dev.: 0.0144)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 5.26% (0.5320 => 0.5600, std.dev.: 0.0087)
  MultiSource/Benchmarks/sim/sim: 4.04% (0.3960 => 0.4120, std.dev.: 0.0060)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.33% (1.0281 => 1.0521, std.dev.: 0.0081)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.68% (0.2840 => 0.3200, std.dev.: 0.0061)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0721 => 1.0841, std.dev.: 0.0035)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/fib2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045)
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037)
  SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045)
  SingleSource/Regression/C++/EH/recursive-throw: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043)
  SingleSource/UnitTests/ms_struct-bitfield-init-1: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042)
  SingleSource/UnitTests/2003-07-09-LoadShorts: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044)
  SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 34.78% (0.0920 => 0.1240, std.dev.: 0.0070)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0044)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.06% (0.2640 => 0.2800, std.dev.: 0.0056)
  SingleSource/UnitTests/Vector/constpool: 5.50% (10.3246 => 10.8927, std.dev.: 0.1833)
  MultiSource/Benchmarks/sim/sim: 4.04% (0.3960 => 0.4120, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.93% (1.1201 => 1.1641, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.44% (1.1641 => 1.2041, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.05% (1.1801 => 1.2161, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.53% (1.2641 => 1.2961, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.47% (1.1321 => 1.1601, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.38% (1.1761 => 1.2041, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.29% (1.2201 => 1.2481, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.27% (1.2361 => 1.2641, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.09% (1.1481 => 1.1721, std.dev.: 0.0088)
  MultiSource/Applications/sqlite3/sqlite3: 1.94% (24.2975 => 24.7695, std.dev.: 0.0728)
  MultiSource/Benchmarks/Bullet/bullet: 1.82% (38.5246 => 39.2246, std.dev.: 0.0790)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.77% (9.5162 => 9.6842, std.dev.: 0.0315)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.71% (11.2203 => 11.4123, std.dev.: 0.0352)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.67% (1.2001 => 1.2201, std.dev.: 0.0061)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.66% (28.9458 => 29.4258, std.dev.: 0.0569)
  MultiSource/Applications/JM/lencod/lencod: 1.56% (19.2805 => 19.5806, std.dev.: 0.0333)
  MultiSource/Applications/SPASS/SPASS: 1.53% (18.5724 => 18.8566, std.dev.: 0.0585)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.49% (5.9164 => 6.0044, std.dev.: 0.0253)
  MultiSource/Applications/ClamAV/clamscan: 1.37% (19.0163 => 19.2764, std.dev.: 0.0502)
  MultiSource/Applications/JM/ldecod/ldecod: 1.37% (8.5002 => 8.6163, std.dev.: 0.0274)
  MultiSource/Applications/lemon/lemon: 1.35% (1.4801 => 1.5001, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.24% (16.5123 => 16.7163, std.dev.: 0.0460)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (4.2323 => 4.2763, std.dev.: 0.0132)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: 13.64% (0.0880 => 0.1000, std.dev.: 0.0039)
  MultiSource/Benchmarks/llubenchmark/llu: 6.86% (5.0723 => 5.4203, std.dev.: 0.0764)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0721 => 1.0841, std.dev.: 0.0035)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -66.14% (145.2571 => 49.1791, std.dev.: 31.1243)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -66.08% (97.4941 => 33.0661, std.dev.: 21.1310)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -62.99% (46.2869 => 17.1291, std.dev.: 10.5928)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -28.85% (3.3282 => 2.3681, std.dev.: 0.1130)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -24.69% (38.3664 => 28.8938, std.dev.: 0.7421)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -12.30% (0.7480 => 0.6560, std.dev.: 0.0352)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.82% (1.3201 => 1.2961, std.dev.: 0.0059)

Report Time: 1.84s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140105/e743d73c/attachment.html>


More information about the llvm-testresults mailing list