[llvm-testresults] pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Dec 29 15:04:38 PST 2013


http://llvm.org/perf/db_default/v4/nts/19279?compare_to=19263&baseline=18571
Nickname: pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64:28

Comparing:
     Run: 19279, Order: 198169, Start Time: 2013-12-29 18:19:47, End Time: 2013-12-29 23:09:08
      To: 19263, Order: 198162, Start Time: 2013-12-29 13:13:06, End Time: 2013-12-29 18:02:12
Baseline: 18571, Order: 197553, Start Time: 2013-12-18 09:16:57, End Time: 2013-12-18 14:35:04

===============
Tests Summary
===============

Performance Regressions: 16 (26 on baseline)
Performance Improvements: 0 (6 on baseline)
Unchanged Tests: 1094 (1078 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2003-05-14-array-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045)
  SingleSource/UnitTests/2008-04-18-LoopBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040)
  SingleSource/UnitTests/2003-07-08-BitOpsTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043)
  SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045)
  SingleSource/Benchmarks/Stanford/Treesort: 50.00% (0.0320 => 0.0480, std.dev.: 0.0059)
  SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036)
  MultiSource/Benchmarks/McCat/18-imp/imp: 7.34% (0.4360 => 0.4680, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout-C++/sieve: 6.25% (0.3200 => 0.3400, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.15% (0.7160 => 0.7600, std.dev.: 0.0155)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.38% (0.7440 => 0.7840, std.dev.: 0.0129)
  SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.3520 => 0.3680, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.30% (0.7280 => 0.7520, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.75% (1.1641 => 1.1961, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.54% (1.1041 => 1.1321, std.dev.: 0.0067)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/fib2: 200.00% (0.0080 => 0.0240, std.dev.: 0.0047)
  SingleSource/Regression/C++/2003-05-14-array-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0027)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.69% (0.2600 => 0.2800, std.dev.: 0.0062)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0055)
  SingleSource/UnitTests/Vector/constpool: 6.97% (10.3246 => 11.0447, std.dev.: 0.1444)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.56% (0.2880 => 0.3040, std.dev.: 0.0059)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.97% (1.4480 => 1.5200, std.dev.: 0.0153)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.30% (0.7280 => 0.7520, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.25% (1.3521 => 1.3961, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.71% (1.1801 => 1.2121, std.dev.: 0.0110)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.33% (2.0640 => 2.1120, std.dev.: 0.0169)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.05% (1.1721 => 1.1961, std.dev.: 0.0062)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (1.0001 => 1.0201, std.dev.: 0.0073)
  MultiSource/Applications/JM/lencod/lencod: 1.70% (19.2805 => 19.6086, std.dev.: 0.0402)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.69% (1.1801 => 1.2001, std.dev.: 0.0077)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.57% (11.4520 => 11.6320, std.dev.: 0.0368)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.54% (1.0361 => 1.0521, std.dev.: 0.0036)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.46% (11.2203 => 11.3843, std.dev.: 0.0588)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.45% (16.5123 => 16.7523, std.dev.: 0.0698)
  MultiSource/Applications/ClamAV/clamscan: 1.39% (19.0163 => 19.2803, std.dev.: 0.0317)
  MultiSource/Benchmarks/Bullet/bullet: 1.16% (38.5246 => 38.9726, std.dev.: 0.0866)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.13% (4.2323 => 4.2803, std.dev.: 0.0064)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (1.3121 => 1.3401, std.dev.: 0.0097)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.23% (2.9202 => 2.9562, std.dev.: 0.0103)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -66.31% (97.4941 => 32.8461, std.dev.: 21.3204)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -66.10% (145.2571 => 49.2471, std.dev.: 31.6842)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -62.99% (46.2869 => 17.1291, std.dev.: 10.4775)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -28.97% (3.3282 => 2.3641, std.dev.: 0.1117)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -24.17% (38.3664 => 29.0938, std.dev.: 0.7862)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.82% (1.3201 => 1.2961, std.dev.: 0.0077)

Report Time: 2.18s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131229/ca041904/attachment.html>


More information about the llvm-testresults mailing list