[llvm-testresults] pollyperf3__pollyperf-O3__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 31 19:59:44 PST 2013


http://llvm.org/perf/db_default/v4/nts/19425?compare_to=19409&baseline=18569
Nickname: pollyperf3__pollyperf-O3__clang_DEV__x86_64:26

Comparing:
     Run: 19425, Order: 198268, Start Time: 2013-12-31 23:20:38, End Time: 2014-01-01 04:04:16
      To: 19409, Order: 198263, Start Time: 2013-12-31 15:56:53, End Time: 2013-12-31 20:40:31
Baseline: 18569, Order: 197553, Start Time: 2013-12-18 09:17:34, End Time: 2013-12-18 14:27:44

===============
Tests Summary
===============

Performance Regressions: 18 (24 on baseline)
Performance Improvements: 0 (5 on baseline)
Unchanged Tests: 1092 (1081 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032)
  SingleSource/UnitTests/2007-01-04-KNR-Args: 150.00% (0.0080 => 0.0200, std.dev.: 0.0022)
  SingleSource/Benchmarks/Stanford/Quicksort: 66.67% (0.0240 => 0.0400, std.dev.: 0.0055)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032)
  SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 33.33% (0.0600 => 0.0800, std.dev.: 0.0049)
  MultiSource/Benchmarks/Olden/mst/mst: 23.33% (0.1200 => 0.1480, std.dev.: 0.0049)
  SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 11.54% (0.1040 => 0.1160, std.dev.: 0.0031)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.11% (0.1080 => 0.1200, std.dev.: 0.0028)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 9.76% (0.1640 => 0.1800, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc/ReedSolomon: 7.84% (0.2040 => 0.2200, std.dev.: 0.0045)
  MultiSource/Benchmarks/McCat/08-main/main: 6.58% (0.3040 => 0.3240, std.dev.: 0.0062)
  SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.2680 => 0.2800, std.dev.: 0.0044)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.97% (0.4040 => 0.4160, std.dev.: 0.0045)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 2.34% (1.7080 => 1.7480, std.dev.: 0.0139)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/five11/five11: 1.04% (2.3121 => 2.3361, std.dev.: 0.0063)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.03% (5.0243 => 5.0763, std.dev.: 0.0159)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl: 400.00% (0.0040 => 0.0200, std.dev.: 0.0054)
  SingleSource/UnitTests/2007-01-04-KNR-Args: 150.00% (0.0080 => 0.0200, std.dev.: 0.0022)
  SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040)
  SingleSource/UnitTests/2003-05-14-AtExit: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032)
  MultiSource/Benchmarks/Olden/tsp/tsp: 16.13% (0.1240 => 0.1440, std.dev.: 0.0069)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 9.76% (0.1640 => 0.1800, std.dev.: 0.0057)
  MultiSource/Benchmarks/Olden/power/power: 7.89% (0.1520 => 0.1640, std.dev.: 0.0033)
  SingleSource/UnitTests/Vector/constpool: 7.50% (10.3446 => 11.1207, std.dev.: 0.1595)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 5.15% (0.3880 => 0.4080, std.dev.: 0.0067)
  SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.2680 => 0.2800, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.37% (1.1881 => 1.2281, std.dev.: 0.0097)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 3.07% (1.6960 => 1.7480, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.64% (1.2121 => 1.2441, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.55% (1.2561 => 1.2881, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.43% (1.1521 => 1.1801, std.dev.: 0.0102)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.13% (0.9401 => 0.9601, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.98% (1.2121 => 1.2361, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.97% (1.2201 => 1.2441, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.95% (1.2321 => 1.2561, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.58% (4.8240 => 4.9000, std.dev.: 0.0276)
  MultiSource/Applications/ClamAV/clamscan: 1.42% (17.2162 => 17.4602, std.dev.: 0.0369)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: 7.89% (0.1520 => 0.1640, std.dev.: 0.0027)
  MultiSource/Applications/minisat/minisat: 1.40% (6.5684 => 6.6604, std.dev.: 0.0351)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -64.76% (139.6807 => 49.2231, std.dev.: 31.8797)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -63.44% (89.9296 => 32.8741, std.dev.: 21.4073)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -25.41% (3.1642 => 2.3601, std.dev.: 0.1132)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.38% (37.3983 => 29.0298, std.dev.: 0.7638)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.47% (2.4522 => 2.4162, std.dev.: 0.0128)

Report Time: 1.98s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131231/75151f44/attachment.html>


More information about the llvm-testresults mailing list