[llvm-testresults] pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jan 6 06:18:31 PST 2014


http://llvm.org/perf/db_default/v4/nts/19839?compare_to=19821&baseline=18571
Nickname: pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64:28

Comparing:
     Run: 19839, Order: 198593, Start Time: 2014-01-06 09:35:29, End Time: 2014-01-06 14:23:09
      To: 19821, Order: 198582, Start Time: 2014-01-06 04:29:36, End Time: 2014-01-06 09:17:13
Baseline: 18571, Order: 197553, Start Time: 2013-12-18 09:16:57, End Time: 2013-12-18 14:35:04

===============
Tests Summary
===============

Performance Regressions: 19 (43 on baseline)
Performance Improvements: 0 (6 on baseline)
Unchanged Tests: 1091 (1061 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/pi: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044)
  SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039)
  SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037)
  SingleSource/Benchmarks/Stanford/FloatMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040)
  SingleSource/UnitTests/Vector/SSE/sse_stepfft: 14.29% (0.1120 => 0.1280, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc/flops: 12.12% (0.1320 => 0.1480, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 10.34% (0.2320 => 0.2560, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.20% (0.2440 => 0.2640, std.dev.: 0.0064)
  SingleSource/Benchmarks/Shootout-C++/sieve: 7.50% (0.3200 => 0.3440, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.84% (0.4680 => 0.5000, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2480 => 0.2600, std.dev.: 0.0044)
  MultiSource/Benchmarks/sim/sim: 4.08% (0.3920 => 0.4080, std.dev.: 0.0042)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.13% (0.7680 => 0.7920, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.05% (1.1721 => 1.1961, std.dev.: 0.0084)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.92% (1.0441 => 1.0641, std.dev.: 0.0066)
  MultiSource/Benchmarks/nbench/nbench: 1.77% (1.3561 => 1.3801, std.dev.: 0.0067)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.14% (2.4642 => 2.4922, std.dev.: 0.0018)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.06% (1.8921 => 1.9121, std.dev.: 0.0028)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/flops-4: 100.00% (0.0200 => 0.0400, std.dev.: 0.0043)
  SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039)
  SingleSource/Benchmarks/Stanford/FloatMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 26.09% (0.0920 => 0.1160, std.dev.: 0.0091)
  SingleSource/Benchmarks/Misc/flops: 8.82% (0.1360 => 0.1480, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 8.33% (0.2400 => 0.2600, std.dev.: 0.0044)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.91% (1.4480 => 1.5480, std.dev.: 0.0257)
  SingleSource/UnitTests/Vector/constpool: 6.90% (10.3246 => 11.0367, std.dev.: 0.1308)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.62% (0.3560 => 0.3760, std.dev.: 0.0070)
  MultiSource/Benchmarks/MallocBench/gs/gs: 4.13% (5.2320 => 5.4480, std.dev.: 0.0562)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.66% (0.7640 => 0.7920, std.dev.: 0.0072)
  MultiSource/Benchmarks/nbench/nbench: 3.61% (1.3320 => 1.3801, std.dev.: 0.0067)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.49% (2.0640 => 2.1360, std.dev.: 0.0200)
  MultiSource/Benchmarks/Prolangs-C/football/football: 3.03% (1.0560 => 1.0880, std.dev.: 0.0115)
  MultiSource/Benchmarks/sim/sim: 3.03% (0.3960 => 0.4080, std.dev.: 0.0042)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.86% (6.7040 => 6.8960, std.dev.: 0.0445)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0066)
  MultiSource/Applications/sqlite3/sqlite3: 2.52% (24.2975 => 24.9095, std.dev.: 0.0389)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.47% (1.1321 => 1.1601, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.38% (1.1761 => 1.2041, std.dev.: 0.0078)
  MultiSource/Benchmarks/PAQ8p/paq8p: 2.36% (2.7082 => 2.7722, std.dev.: 0.0118)
  MultiSource/Applications/JM/ldecod/ldecod: 2.26% (8.5002 => 8.6922, std.dev.: 0.0264)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.17% (11.2203 => 11.4643, std.dev.: 0.0430)
  MultiSource/Applications/lemon/lemon: 2.16% (1.4801 => 1.5121, std.dev.: 0.0116)
  MultiSource/Applications/JM/lencod/lencod: 2.10% (19.2805 => 19.6845, std.dev.: 0.0538)
  MultiSource/Applications/treecc/treecc: 1.98% (2.6280 => 2.6800, std.dev.: 0.0153)
  MultiSource/Applications/SPASS/SPASS: 1.81% (18.5724 => 18.9087, std.dev.: 0.0459)
  MultiSource/Applications/ClamAV/clamscan: 1.81% (19.0163 => 19.3604, std.dev.: 0.0613)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.78% (28.9458 => 29.4618, std.dev.: 0.0499)
  MultiSource/Benchmarks/Bullet/bullet: 1.70% (38.5246 => 39.1806, std.dev.: 0.0666)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.69% (1.1801 => 1.2001, std.dev.: 0.0054)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.66% (1.6841 => 1.7121, std.dev.: 0.0075)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.62% (5.9164 => 6.0124, std.dev.: 0.0267)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.62% (1.2361 => 1.2561, std.dev.: 0.0053)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.61% (4.2323 => 4.3003, std.dev.: 0.0109)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.55% (16.5123 => 16.7683, std.dev.: 0.0490)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.47% (9.5162 => 9.6562, std.dev.: 0.0331)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (3.0122 => 3.0562, std.dev.: 0.0149)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.40% (48.7489 => 49.4329, std.dev.: 0.0948)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.28% (2.1921 => 2.2201, std.dev.: 0.0096)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (0.2440 => 0.2560, std.dev.: 0.0020)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -66.10% (97.4941 => 33.0461, std.dev.: 20.9887)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -65.99% (145.2571 => 49.3991, std.dev.: 30.5954)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -63.09% (46.2869 => 17.0851, std.dev.: 10.7650)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -28.61% (3.3282 => 2.3761, std.dev.: 0.1050)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -26.05% (38.3664 => 28.3738, std.dev.: 0.7526)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.12% (1.3201 => 1.2921, std.dev.: 0.0063)

Report Time: 2.56s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140106/3c95f92b/attachment.html>


More information about the llvm-testresults mailing list