[llvm-testresults] pollyperf3__pollyperf-O3__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 30 01:12:25 PST 2013


http://llvm.org/perf/db_default/v4/nts/19323?compare_to=19303&baseline=18569
Nickname: pollyperf3__pollyperf-O3__clang_DEV__x86_64:26

Comparing:
     Run: 19323, Order: 198200, Start Time: 2013-12-30 04:32:31, End Time: 2013-12-30 09:16:52
      To: 19303, Order: 198182, Start Time: 2013-12-29 23:30:28, End Time: 2013-12-30 04:15:18
Baseline: 18569, Order: 197553, Start Time: 2013-12-18 09:17:34, End Time: 2013-12-18 14:27:44

===============
Tests Summary
===============

Performance Regressions: 17 (28 on baseline)
Performance Improvements: 0 (6 on baseline)
Unchanged Tests: 1093 (1076 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2006-12-01-float_varg: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037)
  SingleSource/UnitTests/ms_struct_pack_layout: 200.00% (0.0080 => 0.0240, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/lowercase: 133.33% (0.0120 => 0.0280, std.dev.: 0.0051)
  SingleSource/UnitTests/2003-08-11-VaListArg: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038)
  SingleSource/Regression/C/bigstack: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 26.67% (0.0600 => 0.0760, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 19.05% (0.0840 => 0.1000, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0038)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.11% (0.1080 => 0.1200, std.dev.: 0.0036)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.09% (0.1760 => 0.1920, std.dev.: 0.0051)
  MultiSource/Benchmarks/McCat/09-vor/vor: 5.56% (0.3600 => 0.3800, std.dev.: 0.0076)
  MultiSource/Applications/hexxagon/hexxagon: 3.60% (1.1120 => 1.1520, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.15% (1.1161 => 1.1401, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.71% (1.1721 => 1.1921, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.66% (1.2041 => 1.2241, std.dev.: 0.0070)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: 5.63% (17.2691 => 18.2411, std.dev.: 0.2800)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.77% (3.8522 => 3.9202, std.dev.: 0.0105)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045)
  SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020)
  SingleSource/Regression/C/test_indvars: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035)
  SingleSource/Regression/C/bigstack: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 26.32% (0.0760 => 0.0960, std.dev.: 0.0044)
  MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout/lists: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.29% (0.1680 => 0.1920, std.dev.: 0.0051)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 12.20% (0.1640 => 0.1840, std.dev.: 0.0068)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.96% (0.2920 => 0.3240, std.dev.: 0.0111)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 8.33% (0.2400 => 0.2600, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.47% (1.1521 => 1.1921, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.03% (1.1881 => 1.2241, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.39% (1.1721 => 1.2001, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.31% (1.2121 => 1.2401, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.29% (1.2201 => 1.2481, std.dev.: 0.0091)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.16% (4.8240 => 4.9280, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.03% (1.1801 => 1.2041, std.dev.: 0.0076)
  MultiSource/Applications/ClamAV/clamscan: 1.97% (17.2162 => 17.5562, std.dev.: 0.0359)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.51% (10.3202 => 10.4762, std.dev.: 0.0219)
  MultiSource/Applications/oggenc/oggenc: 1.39% (5.7404 => 5.8204, std.dev.: 0.0214)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.38% (10.7040 => 10.8520, std.dev.: 0.0501)
  MultiSource/Applications/sqlite3/sqlite3: 1.23% (23.3734 => 23.6614, std.dev.: 0.0270)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.19% (5.6964 => 5.7644, std.dev.: 0.0223)
  MultiSource/Applications/SPASS/SPASS: 1.08% (17.4484 => 17.6364, std.dev.: 0.0493)
  MultiSource/Applications/kimwitu++/kc: 1.05% (18.6290 => 18.8250, std.dev.: 0.0348)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: 7.89% (0.1520 => 0.1640, std.dev.: 0.0024)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -64.62% (139.6807 => 49.4191, std.dev.: 30.0610)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -63.08% (89.9296 => 33.2061, std.dev.: 21.5547)
  SingleSource/Benchmarks/Shootout-C++/strcat: -30.00% (0.0800 => 0.0560, std.dev.: 0.0093)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -25.29% (3.1642 => 2.3641, std.dev.: 0.1090)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.19% (37.3983 => 29.0978, std.dev.: 0.6327)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4522 => 2.4242, std.dev.: 0.0106)

Report Time: 2.99s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131230/bd8ab09c/attachment.html>


More information about the llvm-testresults mailing list