[llvm-testresults] pollyperf3__pollyperf-O3__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Dec 25 21:13:10 PST 2013


http://llvm.org/perf/db_default/v4/nts/19041?compare_to=19014&baseline=18569
Nickname: pollyperf3__pollyperf-O3__clang_DEV__x86_64:26

Comparing:
     Run: 19041, Order: 198029, Start Time: 2013-12-26 00:30:08, End Time: 2013-12-26 05:17:33
      To: 19014, Order: 198011, Start Time: 2013-12-25 11:16:28, End Time: 2013-12-25 16:04:22
Baseline: 18569, Order: 197553, Start Time: 2013-12-18 09:17:34, End Time: 2013-12-18 14:27:44

===============
Tests Summary
===============

Performance Regressions: 20 (30 on baseline)
Performance Improvements: 0 (7 on baseline)
Unchanged Tests: 1090 (1073 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033)
  SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033)
  SingleSource/Regression/C/bigstack: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.36% (0.0440 => 0.0600, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc/dt: 33.33% (0.0360 => 0.0480, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0062)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 23.53% (0.0680 => 0.0840, std.dev.: 0.0051)
  MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0066)
  SingleSource/Benchmarks/McGill/misr: 17.65% (0.0680 => 0.0800, std.dev.: 0.0038)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 9.52% (0.1680 => 0.1840, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout-C++/lists: 7.14% (0.2800 => 0.3000, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.4280 => 0.4440, std.dev.: 0.0049)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.4360 => 0.4520, std.dev.: 0.0051)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.81% (1.7080 => 1.7560, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.05% (1.1721 => 1.1961, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.36% (1.1761 => 1.1921, std.dev.: 0.0057)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Treesort: 28.57% (0.0560 => 0.0720, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc-C++/bigfib: 13.04% (0.2760 => 0.3120, std.dev.: 0.0124)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl: 500.00% (0.0040 => 0.0240, std.dev.: 0.0039)
  SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030)
  SingleSource/UnitTests/2007-01-04-KNR-Args: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030)
  SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042)
  SingleSource/UnitTests/Vector/build2: 66.67% (0.0240 => 0.0400, std.dev.: 0.0033)
  SingleSource/Regression/C/sumarray2d: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.36% (0.0440 => 0.0600, std.dev.: 0.0031)
  MultiSource/Benchmarks/Olden/bisort/bisort: 26.67% (0.0600 => 0.0760, std.dev.: 0.0037)
  SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0066)
  MultiSource/Applications/viterbi/viterbi: 15.91% (0.1760 => 0.2040, std.dev.: 0.0069)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 12.20% (0.1640 => 0.1840, std.dev.: 0.0052)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 9.38% (0.1280 => 0.1400, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/sieve: 9.21% (0.3040 => 0.3320, std.dev.: 0.0085)
  MultiSource/Benchmarks/Olden/bh/bh: 7.59% (0.3160 => 0.3400, std.dev.: 0.0082)
  SingleSource/UnitTests/Vector/constpool: 5.84% (10.3446 => 10.9487, std.dev.: 0.1768)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.30% (1.0560 => 1.1120, std.dev.: 0.0180)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.4280 => 0.4440, std.dev.: 0.0049)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 3.54% (1.6960 => 1.7560, std.dev.: 0.0127)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.51% (1.3680 => 1.4160, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.64% (1.2121 => 1.2441, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.23% (1.2561 => 1.2841, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.08% (1.1521 => 1.1761, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.97% (1.2201 => 1.2441, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.70% (1.1761 => 1.1961, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.36% (1.1761 => 1.1921, std.dev.: 0.0057)
  MultiSource/Applications/ClamAV/clamscan: 1.02% (17.2162 => 17.3922, std.dev.: 0.0475)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.70% (0.7160 => 0.7640, std.dev.: 0.0127)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.19% (4.0203 => 4.0683, std.dev.: 0.0175)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -64.48% (139.6807 => 49.6111, std.dev.: 27.7310)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -63.20% (89.9296 => 33.0941, std.dev.: 19.9249)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -60.25% (43.2667 => 17.1971, std.dev.: 9.8743)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -24.78% (3.1642 => 2.3801, std.dev.: 0.1052)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -20.60% (37.3983 => 29.6939, std.dev.: 0.4129)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4522 => 2.4202, std.dev.: 0.0106)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.4562 => 2.4242, std.dev.: 0.0121)

Report Time: 4.04s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131225/40dff068/attachment.html>


More information about the llvm-testresults mailing list