[llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results

Sat Jan 18 00:44:25 PST 2014

http://llvm.org/perf/db_default/v4/nts/20766?compare_to=20764&baseline=19898
Nickname: pollyperf-O3__clang_DEV__x86_64:34

Comparing:
     Run: 20766, Order: 199538, Start Time: 2014-01-18 04:05:38, End Time: 2014-01-18 08:49:14
      To: 20764, Order: 199535, Start Time: 2014-01-18 02:21:04, End Time: 2014-01-18 07:02:54
Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29

===============
Tests Summary
===============

Performance Regressions: 15 (30 on baseline)
Performance Improvements: 2 (4 on baseline)
Unchanged Tests: 1093 (1076 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-10-12-StructureArgs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0051)
  SingleSource/UnitTests/2002-05-03-NotTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 200.00% (0.0080 => 0.0240, std.dev.: 0.0025)
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032)
  SingleSource/UnitTests/AtomicOps: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039)
  SingleSource/UnitTests/vla: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/mandel: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 13.04% (0.0920 => 0.1040, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.90% (1.2641 => 1.2881, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.69% (1.1841 => 1.2041, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.05% (1.1401 => 1.1521, std.dev.: 0.0042)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/health/health: 4.12% (0.3880 => 0.4040, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.97% (3.8482 => 3.9242, std.dev.: 0.0076)
  SingleSource/Benchmarks/McGill/chomp: 1.30% (0.9241 => 0.9361, std.dev.: 0.0031)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -33.33% (0.0480 => 0.0320, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/hello: -14.29% (0.2240 => 0.1920, std.dev.: 0.0114)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035)
  SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038)
  SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040)
  SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043)
  SingleSource/Benchmarks/Stanford/Treesort: 44.44% (0.0360 => 0.0520, std.dev.: 0.0033)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0061)
  SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0067)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.82% (0.1560 => 0.1760, std.dev.: 0.0068)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0036)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 8.70% (0.3680 => 0.4000, std.dev.: 0.0124)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.14% (0.2800 => 0.3000, std.dev.: 0.0063)
  MultiSource/Applications/sgefa/sgefa: 6.06% (0.3960 => 0.4200, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.2880 => 0.3000, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.69% (1.1881 => 1.2201, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.49% (1.1241 => 1.1521, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.38% (1.1761 => 1.2041, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.22% (1.2601 => 1.2881, std.dev.: 0.0036)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (6.0160 => 6.1320, std.dev.: 0.0336)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.86% (5.8000 => 5.9080, std.dev.: 0.0248)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.69% (1.1841 => 1.2041, std.dev.: 0.0073)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.65% (10.6960 => 10.8720, std.dev.: 0.0515)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020)
  MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 16.07% (0.2240 => 0.2600, std.dev.: 0.0098)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0062)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.52% (2.3881 => 2.2801, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/whetstone: -1.14% (1.4081 => 1.3921, std.dev.: 0.0059)

Report Time: 1.94s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140118/7a4e4336/attachment.html>