[llvm-testresults] pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Jan 5 15:01:53 PST 2014


http://llvm.org/perf/db_default/v4/nts/19779?compare_to=19763&baseline=18571
Nickname: pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64:28

Comparing:
     Run: 19779, Order: 198563, Start Time: 2014-01-05 18:18:54, End Time: 2014-01-05 23:06:30
      To: 19763, Order: 198558, Start Time: 2014-01-05 13:13:20, End Time: 2014-01-05 18:01:06
Baseline: 18571, Order: 197553, Start Time: 2013-12-18 09:16:57, End Time: 2013-12-18 14:35:04

===============
Tests Summary
===============

Performance Regressions: 13 (47 on baseline)
Performance Improvements: 1 (7 on baseline)
Unchanged Tests: 1096 (1056 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041)
  SingleSource/UnitTests/2003-05-26-Shorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045)
  SingleSource/UnitTests/SignlessTypes/ccc: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041)
  SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.00% (0.1600 => 0.1920, std.dev.: 0.0076)
  SingleSource/Benchmarks/Misc/whetstone: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045)
  MultiSource/Benchmarks/FreeBench/neural/neural: 6.00% (0.2000 => 0.2120, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/sieve: 4.88% (0.3280 => 0.3440, std.dev.: 0.0047)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.67% (0.4360 => 0.4520, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.16% (1.3801 => 1.3961, std.dev.: 0.0044)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.56% (0.6320 => 0.7240, std.dev.: 0.0130)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 10.17% (1.1801 => 1.3001, std.dev.: 0.0267)
  MultiSource/Benchmarks/Olden/bisort/bisort: 2.76% (0.7240 => 0.7440, std.dev.: 0.0057)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/flops-1: -27.27% (0.0440 => 0.0320, std.dev.: 0.0044)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-02-CastTest: 60.00% (0.0200 => 0.0320, std.dev.: 0.0031)
  SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0043)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 8.33% (0.2400 => 0.2600, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.74% (0.3560 => 0.3800, std.dev.: 0.0057)
  SingleSource/UnitTests/Vector/constpool: 6.35% (10.3246 => 10.9807, std.dev.: 0.1450)
  MultiSource/Benchmarks/FreeBench/neural/neural: 6.00% (0.2000 => 0.2120, std.dev.: 0.0037)
  MultiSource/Applications/hbd/hbd: 5.16% (1.7040 => 1.7920, std.dev.: 0.0239)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.07% (1.1801 => 1.2281, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.82% (1.1521 => 1.1961, std.dev.: 0.0089)
  MultiSource/Applications/obsequi/Obsequi: 3.49% (1.3760 => 1.4240, std.dev.: 0.0148)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.29% (2.0640 => 2.1320, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.25% (1.3521 => 1.3961, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.21% (1.1201 => 1.1561, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.09% (1.1641 => 1.2001, std.dev.: 0.0082)
  MultiSource/Benchmarks/Prolangs-C/football/football: 3.03% (1.0560 => 1.0880, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.86% (1.1201 => 1.1521, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.83% (1.1321 => 1.1641, std.dev.: 0.0108)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.75% (0.7280 => 0.7480, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.72% (1.1761 => 1.2081, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.49% (1.2841 => 1.3161, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.47% (1.1321 => 1.1601, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.47% (1.1321 => 1.1601, std.dev.: 0.0101)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.23% (5.9164 => 6.0484, std.dev.: 0.0261)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.16% (28.9458 => 29.5698, std.dev.: 0.0459)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.11% (1.1401 => 1.1641, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.01% (1.1921 => 1.2161, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.99% (1.2081 => 1.2321, std.dev.: 0.0078)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.93% (11.2203 => 11.4363, std.dev.: 0.0292)
  MultiSource/Applications/lemon/lemon: 1.89% (1.4801 => 1.5081, std.dev.: 0.0082)
  MultiSource/Applications/sqlite3/sqlite3: 1.88% (24.2975 => 24.7535, std.dev.: 0.0570)
  MultiSource/Benchmarks/Bullet/bullet: 1.84% (38.5246 => 39.2326, std.dev.: 0.1089)
  MultiSource/Applications/JM/lencod/lencod: 1.70% (19.2805 => 19.6086, std.dev.: 0.0467)
  MultiSource/Applications/JM/ldecod/ldecod: 1.69% (8.5002 => 8.6442, std.dev.: 0.0412)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.67% (6.7040 => 6.8160, std.dev.: 0.0388)
  MultiSource/Applications/SPASS/SPASS: 1.66% (18.5724 => 18.8806, std.dev.: 0.0546)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.62% (2.7082 => 2.7522, std.dev.: 0.0113)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.61% (4.2323 => 4.3003, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.55% (1.2881 => 1.3081, std.dev.: 0.0072)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.48% (48.7489 => 49.4689, std.dev.: 0.0910)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.43% (16.5123 => 16.7483, std.dev.: 0.0725)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.39% (9.5162 => 9.6482, std.dev.: 0.0473)
  MultiSource/Applications/ClamAV/clamscan: 1.30% (19.0163 => 19.2643, std.dev.: 0.0577)
  MultiSource/Applications/kimwitu++/kc: 1.11% (19.5411 => 19.7571, std.dev.: 0.0700)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 6.21% (1.2241 => 1.3001, std.dev.: 0.0267)
  MultiSource/Applications/minisat/minisat: 1.24% (6.7804 => 6.8644, std.dev.: 0.0206)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -66.31% (97.4941 => 32.8421, std.dev.: 21.5019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -66.23% (145.2571 => 49.0551, std.dev.: 29.7755)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -63.43% (46.2869 => 16.9251, std.dev.: 10.8153)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -28.85% (3.3282 => 2.3681, std.dev.: 0.1115)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -24.54% (38.3664 => 28.9498, std.dev.: 0.6339)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -4.24% (6.5084 => 6.2324, std.dev.: 0.1063)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.12% (1.3201 => 1.2921, std.dev.: 0.0059)

Report Time: 2.36s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140105/e6c432e3/attachment.html>


More information about the llvm-testresults mailing list