[llvm-testresults] pollyperf4__pollyperf-O3__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Jan 5 07:48:04 PST 2014


http://llvm.org/perf/db_default/v4/nts/19757?compare_to=19736&baseline=18565
Nickname: pollyperf4__pollyperf-O3__clang_DEV__x86_64:24

Comparing:
     Run: 19757, Order: 198556, Start Time: 2014-01-05 11:09:58, End Time: 2014-01-05 15:52:43
      To: 19736, Order: 198546, Start Time: 2014-01-05 06:08:24, End Time: 2014-01-05 10:51:00
Baseline: 18565, Order: 197552, Start Time: 2013-12-18 08:27:56, End Time: 2013-12-18 13:39:39

===============
Tests Summary
===============

Performance Regressions: 10 (33 on baseline)
Performance Improvements: 0 (7 on baseline)
Unchanged Tests: 1100 (1070 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035)
  SingleSource/Regression/C/callargs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.70% (0.2920 => 0.3320, std.dev.: 0.0149)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.82% (0.6640 => 0.6960, std.dev.: 0.0105)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.00% (0.3000 => 0.3120, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.02% (0.9281 => 0.9561, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.03% (1.1841 => 1.2081, std.dev.: 0.0073)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/five11/five11: 1.39% (2.3041 => 2.3361, std.dev.: 0.0065)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2007-01-04-KNR-Args: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045)
  SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031)
  SingleSource/Benchmarks/Stanford/Bubblesort: 83.33% (0.0240 => 0.0440, std.dev.: 0.0044)
  SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/perlin: 30.77% (0.0520 => 0.0680, std.dev.: 0.0027)
  SingleSource/Benchmarks/McGill/queens: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.67% (0.0600 => 0.0760, std.dev.: 0.0057)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.70% (0.2920 => 0.3320, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.31% (1.2081 => 1.2481, std.dev.: 0.0070)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.19% (1.5040 => 1.5520, std.dev.: 0.0134)
  MultiSource/Applications/treecc/treecc: 2.67% (2.4000 => 2.4640, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.40% (1.1681 => 1.1961, std.dev.: 0.0074)
  MultiSource/Applications/lemon/lemon: 2.06% (1.3601 => 1.3881, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.03% (1.1841 => 1.2081, std.dev.: 0.0073)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (2.7802 => 2.8322, std.dev.: 0.0095)
  MultiSource/Applications/sqlite3/sqlite3: 1.85% (23.3854 => 23.8175, std.dev.: 0.0365)
  MultiSource/Applications/siod/siod: 1.73% (2.5361 => 2.5801, std.dev.: 0.0162)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.70% (0.9401 => 0.9561, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.69% (1.1841 => 1.2041, std.dev.: 0.0054)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.66% (27.7977 => 28.2578, std.dev.: 0.0592)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.40% (2.5722 => 2.6082, std.dev.: 0.0073)
  MultiSource/Applications/JM/lencod/lencod: 1.30% (17.5685 => 17.7965, std.dev.: 0.0594)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.17% (15.0802 => 15.2562, std.dev.: 0.0442)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.12% (10.3562 => 10.4722, std.dev.: 0.0316)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.11% (3.9682 => 4.0122, std.dev.: 0.0125)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.00% (0.1000 => 0.1120, std.dev.: 0.0024)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.48% (1.1761 => 1.2641, std.dev.: 0.0104)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.52% (0.1840 => 0.1960, std.dev.: 0.0020)
  MultiSource/Applications/sgefa/sgefa: 2.33% (0.5160 => 0.5280, std.dev.: 0.0016)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.31% (3.9602 => 4.0122, std.dev.: 0.0108)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.15% (1.3921 => 1.4081, std.dev.: 0.0045)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.04% (2.3121 => 2.3361, std.dev.: 0.0065)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -63.33% (90.4297 => 33.1621, std.dev.: 20.7600)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -63.02% (46.3269 => 17.1331, std.dev.: 10.4822)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -60.77% (125.5798 => 49.2591, std.dev.: 29.3402)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -26.53% (3.2122 => 2.3601, std.dev.: 0.1074)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.83% (37.8384 => 28.8218, std.dev.: 0.9309)
  SingleSource/Benchmarks/McGill/chomp: -13.43% (1.0721 => 0.9281, std.dev.: 0.0061)
  MultiSource/Applications/aha/aha: -1.33% (2.7082 => 2.6722, std.dev.: 0.0036)

Report Time: 2.06s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140105/d5b20878/attachment.html>


More information about the llvm-testresults mailing list