[llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Jan 19 14:04:22 PST 2014


http://llvm.org/perf/db_default/v4/nts/20834?compare_to=20822&baseline=19899
Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35

Comparing:
     Run: 20834, Order: 199605, Start Time: 2014-01-19 17:21:13, End Time: 2014-01-19 22:09:17
      To: 20822, Order: 199587, Start Time: 2014-01-19 12:30:13, End Time: 2014-01-19 17:17:44
Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02

===============
Tests Summary
===============

Performance Regressions: 18 (37 on baseline)
Performance Improvements: 1 (1 on baseline)
Unchanged Tests: 1091 (1072 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2006-12-01-float_varg: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045)
  SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045)
  SingleSource/UnitTests/2003-10-13-SwitchTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026)
  SingleSource/UnitTests/initp1: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 26.92% (0.1040 => 0.1320, std.dev.: 0.0040)
  MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/whetstone: 16.67% (0.0960 => 0.1120, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 15.00% (0.0800 => 0.0920, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/mst/mst: 14.71% (0.1360 => 0.1560, std.dev.: 0.0076)
  MultiSource/Benchmarks/FreeBench/distray/distray: 13.79% (0.1160 => 0.1320, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.11% (0.2960 => 0.3200, std.dev.: 0.0074)
  MultiSource/Benchmarks/McCat/18-imp/imp: 6.31% (0.4440 => 0.4720, std.dev.: 0.0073)
  SingleSource/Benchmarks/Linpack/linpack-pc: 5.19% (0.3080 => 0.3240, std.dev.: 0.0058)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.41% (1.4520 => 1.5160, std.dev.: 0.0180)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/llubenchmark/llu: 4.73% (5.1603 => 5.4043, std.dev.: 0.0789)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.26% (3.9242 => 4.0523, std.dev.: 0.0421)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.37% (1.4641 => 1.4841, std.dev.: 0.0030)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Stanford/Quicksort: -38.46% (0.0520 => 0.0320, std.dev.: 0.0077)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043)
  SingleSource/UnitTests/2003-10-13-SwitchTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 21.05% (0.0760 => 0.0920, std.dev.: 0.0038)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0065)
  MultiSource/Benchmarks/NPB-serial/is/is: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0066)
  MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0041)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.09% (0.1760 => 0.1920, std.dev.: 0.0057)
  MultiSource/Applications/viterbi/viterbi: 7.55% (0.2120 => 0.2280, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout-C++/ary: 5.71% (0.2800 => 0.2960, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.71% (0.6800 => 0.7120, std.dev.: 0.0098)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.01% (9.5802 => 9.8682, std.dev.: 0.0519)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.76% (0.5800 => 0.5960, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.47% (1.1321 => 1.1601, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.39% (1.1721 => 1.2001, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.36% (1.1881 => 1.2161, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.33% (1.2001 => 1.2281, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.27% (1.2321 => 1.2601, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.17% (1.2921 => 1.3201, std.dev.: 0.0051)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.15% (0.7440 => 0.7600, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.92% (1.2521 => 1.2761, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.62% (1.2321 => 1.2521, std.dev.: 0.0076)
  MultiSource/Applications/oggenc/oggenc: 1.59% (6.2844 => 6.3844, std.dev.: 0.0163)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.45% (2.2081 => 2.2401, std.dev.: 0.0080)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.32% (2.7282 => 2.7642, std.dev.: 0.0094)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.12% (11.3843 => 11.5123, std.dev.: 0.0436)
  MultiSource/Applications/JM/ldecod/ldecod: 1.03% (8.5802 => 8.6682, std.dev.: 0.0339)
  MultiSource/Applications/JM/lencod/lencod: 1.02% (19.5406 => 19.7406, std.dev.: 0.0346)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/strcat: 12.50% (0.1280 => 0.1440, std.dev.: 0.0047)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.13% (3.9842 => 4.2283, std.dev.: 0.0125)
  MultiSource/Benchmarks/llubenchmark/llu: 5.55% (5.1203 => 5.4043, std.dev.: 0.0789)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.43% (3.3122 => 3.4922, std.dev.: 0.0523)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.70% (5.4123 => 5.5043, std.dev.: 0.0356)
  MultiSource/Applications/aha/aha: 1.39% (2.8802 => 2.9202, std.dev.: 0.0039)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/flops-1: -40.00% (0.0400 => 0.0240, std.dev.: 0.0057)

Report Time: 2.22s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140119/65721cd0/attachment.html>


More information about the llvm-testresults mailing list