[llvm-testresults] pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Jan 5 09:56:27 PST 2014


http://llvm.org/perf/db_default/v4/nts/19763?compare_to=19743&baseline=18571
Nickname: pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64:28

Comparing:
     Run: 19763, Order: 198558, Start Time: 2014-01-05 13:13:20, End Time: 2014-01-05 18:01:06
      To: 19743, Order: 198551, Start Time: 2014-01-05 08:08:12, End Time: 2014-01-05 12:55:31
Baseline: 18571, Order: 197553, Start Time: 2013-12-18 09:16:57, End Time: 2013-12-18 14:35:04

===============
Tests Summary
===============

Performance Regressions: 14 (46 on baseline)
Performance Improvements: 0 (7 on baseline)
Unchanged Tests: 1096 (1057 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042)
  SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042)
  MultiSource/Benchmarks/Olden/em3d/em3d: 19.15% (0.1880 => 0.2240, std.dev.: 0.0103)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 17.65% (0.0680 => 0.0800, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.00% (0.0800 => 0.0920, std.dev.: 0.0044)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0074)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.35% (0.2520 => 0.2680, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.88% (0.3280 => 0.3440, std.dev.: 0.0059)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.63% (1.2120 => 1.2560, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.86% (1.2881 => 1.3121, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.34% (1.1921 => 1.2081, std.dev.: 0.0052)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 32.14% (0.1120 => 0.1480, std.dev.: 0.0111)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-4: 100.00% (0.0200 => 0.0400, std.dev.: 0.0054)
  SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 39.13% (0.0920 => 0.1280, std.dev.: 0.0067)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.06% (0.2480 => 0.2680, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.17% (1.1720 => 1.2560, std.dev.: 0.0090)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.56% (0.2160 => 0.2280, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.78% (1.1641 => 1.2081, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.57% (1.1201 => 1.1601, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.06% (1.1761 => 1.2121, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.05% (1.1801 => 1.2161, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.91% (1.2361 => 1.2721, std.dev.: 0.0092)
  MultiSource/Benchmarks/nbench/nbench: 2.71% (1.3320 => 1.3681, std.dev.: 0.0135)
  MultiSource/Applications/lemon/lemon: 2.43% (1.4801 => 1.5161, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.43% (1.1521 => 1.1801, std.dev.: 0.0072)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.37% (5.5800 => 5.7120, std.dev.: 0.0339)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.33% (1.2001 => 1.2281, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.33% (2.0640 => 2.1120, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.32% (1.2081 => 1.2361, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.27% (1.2361 => 1.2641, std.dev.: 0.0104)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.25% (11.2203 => 11.4723, std.dev.: 0.0261)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.23% (5.9164 => 6.0484, std.dev.: 0.0213)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.12% (1.1321 => 1.1561, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.05% (1.1721 => 1.1961, std.dev.: 0.0063)
  MultiSource/Applications/JM/ldecod/ldecod: 2.02% (8.5002 => 8.6723, std.dev.: 0.0377)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.95% (1.2281 => 1.2521, std.dev.: 0.0086)
  MultiSource/Applications/JM/lencod/lencod: 1.95% (19.2805 => 19.6566, std.dev.: 0.0590)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.93% (1.0361 => 1.0561, std.dev.: 0.0077)
  MultiSource/Applications/sqlite3/sqlite3: 1.93% (24.2975 => 24.7655, std.dev.: 0.0779)
  MultiSource/Benchmarks/Bullet/bullet: 1.91% (38.5246 => 39.2606, std.dev.: 0.0796)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.86% (1.2881 => 1.3121, std.dev.: 0.0065)
  MultiSource/Applications/d/make_dparser: 1.77% (4.0641 => 4.1361, std.dev.: 0.0258)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.74% (28.9458 => 29.4498, std.dev.: 0.0840)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.70% (16.5123 => 16.7923, std.dev.: 0.0451)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.66% (1.6841 => 1.7121, std.dev.: 0.0097)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.62% (2.7082 => 2.7522, std.dev.: 0.0095)
  MultiSource/Applications/SPASS/SPASS: 1.60% (18.5724 => 18.8687, std.dev.: 0.0520)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.51% (9.5162 => 9.6602, std.dev.: 0.0418)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.51% (4.2323 => 4.2963, std.dev.: 0.0115)
  MultiSource/Applications/ClamAV/clamscan: 1.49% (19.0163 => 19.3004, std.dev.: 0.0508)
  MultiSource/Applications/lua/lua: 1.43% (4.7560 => 4.8240, std.dev.: 0.0224)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.42% (48.7489 => 49.4409, std.dev.: 0.0696)
  MultiSource/Applications/kimwitu++/kc: 1.33% (19.5411 => 19.8011, std.dev.: 0.0450)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (3.0122 => 3.0522, std.dev.: 0.0139)
  MultiSource/Applications/oggenc/oggenc: 1.09% (6.2644 => 6.3324, std.dev.: 0.0195)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/spiff/spiff: 4.67% (2.1401 => 2.2401, std.dev.: 0.0374)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -66.15% (97.4941 => 33.0021, std.dev.: 20.8723)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -66.07% (145.2571 => 49.2871, std.dev.: 29.1359)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -63.17% (46.2869 => 17.0491, std.dev.: 10.4016)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -29.21% (3.3282 => 2.3561, std.dev.: 0.1115)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -25.39% (38.3664 => 28.6258, std.dev.: 0.7157)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.70% (6.5084 => 6.3324, std.dev.: 0.0557)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.12% (1.3201 => 1.2921, std.dev.: 0.0073)

Report Time: 2.18s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140105/c75116ec/attachment.html>


More information about the llvm-testresults mailing list