[llvm-testresults] pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 30 06:26:17 PST 2013


http://llvm.org/perf/db_default/v4/nts/19334?compare_to=19324&baseline=18571
Nickname: pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64:28

Comparing:
     Run: 19334, Order: 198206, Start Time: 2013-12-30 09:40:42, End Time: 2013-12-30 14:30:27
      To: 19324, Order: 198200, Start Time: 2013-12-30 04:33:34, End Time: 2013-12-30 09:23:09
Baseline: 18571, Order: 197553, Start Time: 2013-12-18 09:16:57, End Time: 2013-12-18 14:35:04

===============
Tests Summary
===============

Performance Regressions: 16 (40 on baseline)
Performance Improvements: 1 (6 on baseline)
Unchanged Tests: 1093 (1064 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/EH/recursive-throw: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/lowercase: 60.00% (0.0200 => 0.0320, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 19.05% (0.0840 => 0.1000, std.dev.: 0.0049)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.48% (0.2440 => 0.2720, std.dev.: 0.0103)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.17% (0.2320 => 0.2440, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.88% (0.3280 => 0.3440, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.75% (1.1441 => 1.1641, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.68% (1.1881 => 1.2081, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.63% (1.2281 => 1.2481, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.45% (1.3761 => 1.3961, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.16% (1.3761 => 1.3921, std.dev.: 0.0061)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 28.57% (0.0560 => 0.0720, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 9.09% (0.3520 => 0.3840, std.dev.: 0.0117)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.65% (0.3440 => 0.3600, std.dev.: 0.0045)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.12% (1.3201 => 1.3481, std.dev.: 0.0103)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: -1.04% (3.0802 => 3.0482, std.dev.: 0.0115)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/flops-4: 100.00% (0.0200 => 0.0400, std.dev.: 0.0071)
  SingleSource/Regression/C++/fixups: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045)
  SingleSource/Regression/C/matrixTranspose: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035)
  SingleSource/UnitTests/initp1: 36.36% (0.0440 => 0.0600, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 6.59% (0.3640 => 0.3880, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.17% (0.2320 => 0.2440, std.dev.: 0.0028)
  SingleSource/Regression/C++/ofstream_ctor: 5.17% (0.2320 => 0.2440, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.96% (1.3521 => 1.3921, std.dev.: 0.0061)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.91% (2.0640 => 2.1240, std.dev.: 0.0205)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.86% (1.1201 => 1.1521, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.83% (1.1321 => 1.1641, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.72% (1.1761 => 1.2081, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.34% (1.7120 => 1.7520, std.dev.: 0.0147)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.29% (1.2201 => 1.2481, std.dev.: 0.0062)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.22% (5.5800 => 5.7040, std.dev.: 0.0297)
  MultiSource/Applications/lemon/lemon: 2.16% (1.4801 => 1.5121, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.05% (1.3681 => 1.3961, std.dev.: 0.0061)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.97% (6.7040 => 6.8360, std.dev.: 0.0403)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.94% (1.2361 => 1.2601, std.dev.: 0.0067)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.93% (11.2203 => 11.4363, std.dev.: 0.0309)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.57% (16.5123 => 16.7723, std.dev.: 0.0455)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.56% (9.5162 => 9.6642, std.dev.: 0.0359)
  MultiSource/Benchmarks/Bullet/bullet: 1.54% (38.5246 => 39.1166, std.dev.: 0.0683)
  MultiSource/Applications/JM/lencod/lencod: 1.47% (19.2805 => 19.5646, std.dev.: 0.0400)
  MultiSource/Applications/SPASS/SPASS: 1.42% (18.5724 => 18.8364, std.dev.: 0.0643)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (5.9164 => 5.9964, std.dev.: 0.0195)
  MultiSource/Applications/oggenc/oggenc: 1.34% (6.2644 => 6.3484, std.dev.: 0.0179)
  MultiSource/Applications/ClamAV/clamscan: 1.24% (19.0163 => 19.2523, std.dev.: 0.0639)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.21% (5.3080 => 5.3720, std.dev.: 0.0247)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.08% (48.7489 => 49.2769, std.dev.: 0.1117)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (28.9458 => 29.2498, std.dev.: 0.0898)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (4.2323 => 4.2763, std.dev.: 0.0102)
  MultiSource/Applications/JM/ldecod/ldecod: 1.04% (8.5002 => 8.5882, std.dev.: 0.0241)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.45% (0.3480 => 0.3600, std.dev.: 0.0045)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.74% (1.3121 => 1.3481, std.dev.: 0.0103)
  MultiSource/Applications/minisat/minisat: 1.06% (6.7804 => 6.8524, std.dev.: 0.0156)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -66.18% (97.4941 => 32.9701, std.dev.: 21.9463)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -66.08% (145.2571 => 49.2671, std.dev.: 31.5649)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -62.98% (46.2869 => 17.1371, std.dev.: 10.9648)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -28.97% (3.3282 => 2.3641, std.dev.: 0.1120)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -25.27% (38.3664 => 28.6698, std.dev.: 0.7200)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.82% (1.3201 => 1.2961, std.dev.: 0.0061)

Report Time: 7.29s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131230/058bb561/attachment.html>


More information about the llvm-testresults mailing list