[llvm-testresults] pollyperf4__pollyperf-O3__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Dec 27 17:01:37 PST 2013


http://llvm.org/perf/db_default/v4/nts/19139?compare_to=19109&baseline=18565
Nickname: pollyperf4__pollyperf-O3__clang_DEV__x86_64:24

Comparing:
     Run: 19139, Order: 198082, Start Time: 2013-12-27 20:19:52, End Time: 2013-12-28 01:06:04
      To: 19109, Order: 198070, Start Time: 2013-12-27 07:06:40, End Time: 2013-12-27 11:51:44
Baseline: 18565, Order: 197552, Start Time: 2013-12-18 08:27:56, End Time: 2013-12-18 13:39:39

===============
Tests Summary
===============

Performance Regressions: 22 (29 on baseline)
Performance Improvements: 0 (4 on baseline)
Unchanged Tests: 1088 (1077 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/stmtexpr: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/flops-8: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: 33.33% (0.0600 => 0.0800, std.dev.: 0.0051)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047)
  MultiSource/Benchmarks/NPB-serial/is/is: 18.75% (0.0640 => 0.0760, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.67% (0.0960 => 0.1120, std.dev.: 0.0047)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.89% (0.2880 => 0.3280, std.dev.: 0.0078)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 7.55% (0.2120 => 0.2280, std.dev.: 0.0061)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.83% (1.0760 => 1.1280, std.dev.: 0.0134)
  SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.2680 => 0.2800, std.dev.: 0.0039)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.68% (1.0880 => 1.1280, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.66% (1.2041 => 1.2361, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.12% (1.1321 => 1.1561, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.62% (1.2321 => 1.2521, std.dev.: 0.0078)
  MultiSource/Applications/oggenc/oggenc: 1.40% (5.7164 => 5.7964, std.dev.: 0.0130)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.26% (2.5402 => 2.5722, std.dev.: 0.0106)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.11% (3.9722 => 4.0163, std.dev.: 0.0078)
  MultiSource/Applications/ClamAV/clamscan: 1.06% (17.3042 => 17.4882, std.dev.: 0.0414)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 2.71% (3.9882 => 4.0963, std.dev.: 0.0319)
  SingleSource/Benchmarks/Misc/ffbench: 1.35% (0.8921 => 0.9041, std.dev.: 0.0045)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/stmtexpr: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036)
  SingleSource/UnitTests/Vector/simple: 133.33% (0.0120 => 0.0280, std.dev.: 0.0028)
  SingleSource/Benchmarks/Stanford/Bubblesort: 66.67% (0.0240 => 0.0400, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/flops-8: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/fbench: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.0840 => 0.0960, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 12.33% (0.2920 => 0.3280, std.dev.: 0.0078)
  MultiSource/Benchmarks/Olden/bh/bh: 10.26% (0.3120 => 0.3440, std.dev.: 0.0085)
  SingleSource/Benchmarks/Misc/oourafft: 6.06% (0.2640 => 0.2800, std.dev.: 0.0039)
  MultiSource/Benchmarks/McCat/18-imp/imp: 6.00% (0.4000 => 0.4240, std.dev.: 0.0082)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.88% (0.3400 => 0.3600, std.dev.: 0.0060)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.4360 => 0.4520, std.dev.: 0.0054)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.64% (0.6600 => 0.6840, std.dev.: 0.0074)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.05% (1.1681 => 1.1921, std.dev.: 0.0054)
  MultiSource/Applications/lemon/lemon: 1.76% (1.3601 => 1.3841, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.76% (1.1361 => 1.1561, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.75% (1.1441 => 1.1641, std.dev.: 0.0061)
  MultiSource/Applications/siod/siod: 1.73% (2.5361 => 2.5801, std.dev.: 0.0157)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.51% (7.9681 => 8.0881, std.dev.: 0.0392)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.45% (5.7840 => 5.8680, std.dev.: 0.0280)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.44% (2.7802 => 2.8202, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.31% (1.2201 => 1.2361, std.dev.: 0.0032)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (3.9682 => 4.0163, std.dev.: 0.0078)
  MultiSource/Applications/oggenc/oggenc: 1.19% (5.7284 => 5.7964, std.dev.: 0.0130)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.97% (0.7240 => 0.7600, std.dev.: 0.0132)
  SingleSource/Benchmarks/Misc/ffbench: 1.35% (0.8921 => 0.9041, std.dev.: 0.0045)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.21% (2.3121 => 2.3401, std.dev.: 0.0074)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -63.23% (90.4297 => 33.2541, std.dev.: 20.8427)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -62.94% (46.3269 => 17.1691, std.dev.: 10.8526)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -26.03% (3.2122 => 2.3761, std.dev.: 0.0995)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.78% (37.8384 => 28.8418, std.dev.: 0.6932)

Report Time: 2.08s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131227/f19632ba/attachment.html>


More information about the llvm-testresults mailing list