[llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results

Wed Feb 19 07:48:48 PST 2014

http://llvm.org/perf/db_default/v4/nts/22457?compare_to=22444&baseline=21467
Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38

Comparing:
     Run: 22457, Order: 201657, Start Time: 2014-02-19 10:53:53, End Time: 2014-02-19 15:54:20
      To: 22444, Order: 201639, Start Time: 2014-02-19 05:40:06, End Time: 2014-02-19 10:40:57
Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53

===============
Tests Summary
===============

New Passes: 0 (11 on baseline)
Performance Regressions: 13 (22 on baseline)
Performance Improvements: 0 (11 on baseline)
Unchanged Tests: 1097 (1066 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/PR491: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041)
  SingleSource/Benchmarks/Stanford/Quicksort: 57.14% (0.0280 => 0.0440, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout/random: 50.00% (0.0240 => 0.0360, std.dev.: 0.0024)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 40.00% (0.0400 => 0.0560, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.00% (0.1000 => 0.1120, std.dev.: 0.0028)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0036)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.26% (0.1560 => 0.1720, std.dev.: 0.0038)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0041)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/health/health: 7.29% (0.3840 => 0.4120, std.dev.: 0.0090)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 4.80% (1.0841 => 1.1361, std.dev.: 0.0136)
  MultiSource/Benchmarks/Olden/bisort/bisort: 1.63% (0.7360 => 0.7480, std.dev.: 0.0035)
  SingleSource/Benchmarks/McGill/chomp: 1.30% (0.9241 => 0.9361, std.dev.: 0.0038)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Compile Time
-------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/7zip/7zip-benchmark
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
  SingleSource/Benchmarks/Misc/oourafft
  MultiSource/Applications/ClamAV/clamscan: 7.85% (17.6723 => 19.0604, std.dev.: 0.0794)
  MultiSource/Applications/sqlite3/sqlite3: 1409.65% (1.7001 => 25.6656, std.dev.: 0.0342)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 0.32% (50.1010 => 50.2610, std.dev.: 0.1069)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 0.38% (1.0520 => 1.0560, std.dev.: 0.0235)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.83% (11.3920 => 11.6000, std.dev.: 0.0717)
  SingleSource/Benchmarks/Misc/oourafft: 745.93% (11.3407 => 95.9340, std.dev.: 0.1404)

New Passes - Execution Time
---------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
  SingleSource/Benchmarks/Misc/oourafft
  MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0074)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 3.9522, std.dev.: 0.0177)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3801, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000)
  SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.8524, std.dev.: 0.0150)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027)
  SingleSource/Regression/C/sumarray2d: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041)
  SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043)
  SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.00% (0.1000 => 0.1120, std.dev.: 0.0028)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 8.93% (0.2240 => 0.2440, std.dev.: 0.0040)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 8.33% (0.1920 => 0.2080, std.dev.: 0.0048)
  SingleSource/Benchmarks/Linpack/linpack-pc: 3.75% (0.3200 => 0.3320, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.41% (1.8281 => 1.8721, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.16% (1.8561 => 1.8961, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.99% (1.8081 => 1.8441, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.69% (1.8921 => 1.9241, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.66% (1.9241 => 1.9561, std.dev.: 0.0095)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.63% (0.9801 => 0.9961, std.dev.: 0.0059)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.48% (6.4800 => 6.5760, std.dev.: 0.0325)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.29% (2.1201 => 2.4442, std.dev.: 0.0460)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 4.03% (1.0921 => 1.1361, std.dev.: 0.0136)
  MultiSource/Benchmarks/Olden/tsp/tsp: 3.11% (1.2881 => 1.3281, std.dev.: 0.0112)
  SingleSource/Benchmarks/McGill/chomp: 1.30% (0.9241 => 0.9361, std.dev.: 0.0038)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -20.00% (0.0800 => 0.0640, std.dev.: 0.0062)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -8.14% (0.6880 => 0.6320, std.dev.: 0.0095)
  MultiSource/Benchmarks/mafft/pairlocalalign: -3.22% (13.0363 => 12.6163, std.dev.: 0.0323)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.04% (94.8339 => 49.2751, std.dev.: 8.2353)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.10% (49.9431 => 32.9141, std.dev.: 0.2764)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.45% (25.7136 => 17.1131, std.dev.: 0.1000)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.21% (37.0863 => 28.4778, std.dev.: 2.8422)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -22.79% (3.0722 => 2.3721, std.dev.: 0.0989)
  SingleSource/Benchmarks/Linpack/linpack-pc: -14.23% (7.8165 => 6.7044, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0292)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.1563 => 5.1003, std.dev.: 0.0215)

Report Time: 1.05s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140219/4b0ceea7/attachment.html>