[llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results

Thu Feb 20 04:48:27 PST 2014

http://llvm.org/perf/db_default/v4/nts/22505?compare_to=22491&baseline=21467
Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38

Comparing:
     Run: 22505, Order: 201762, Start Time: 2014-02-20 07:53:17, End Time: 2014-02-20 12:53:55
      To: 22491, Order: 201749, Start Time: 2014-02-20 02:41:24, End Time: 2014-02-20 07:41:55
Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53

===============
Tests Summary
===============

New Passes: 0 (11 on baseline)
Performance Regressions: 9 (35 on baseline)
Performance Improvements: 3 (10 on baseline)
Unchanged Tests: 1098 (1054 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/cast-bug: 200.00% (0.0080 => 0.0240, std.dev.: 0.0037)
  SingleSource/Regression/C/compare: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043)
  SingleSource/UnitTests/Vector/simple: 75.00% (0.0160 => 0.0280, std.dev.: 0.0026)
  SingleSource/Benchmarks/Stanford/Quicksort: 50.00% (0.0320 => 0.0480, std.dev.: 0.0039)
  SingleSource/Benchmarks/McGill/exptree: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 8.65% (0.4160 => 0.4520, std.dev.: 0.0133)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.95% (0.3360 => 0.3560, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.17% (0.2320 => 0.2440, std.dev.: 0.0040)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.85% (0.9841 => 1.0121, std.dev.: 0.0084)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -16.00% (0.2000 => 0.1680, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.46% (2.1921 => 2.1601, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.41% (1.9881 => 1.9601, std.dev.: 0.0103)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Compile Time
-------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/7zip/7zip-benchmark
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
  SingleSource/Benchmarks/Misc/oourafft
  MultiSource/Applications/ClamAV/clamscan: 8.96% (17.6723 => 19.2564, std.dev.: 0.0392)
  MultiSource/Applications/sqlite3/sqlite3: 1417.89% (1.7001 => 25.8056, std.dev.: 0.0476)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 0.64% (50.1010 => 50.4210, std.dev.: 0.0926)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.90% (1.0520 => 1.0320, std.dev.: 0.0277)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.02% (11.3920 => 11.7360, std.dev.: 0.0607)
  SingleSource/Benchmarks/Misc/oourafft: 745.71% (11.3407 => 95.9100, std.dev.: 0.1443)

New Passes - Execution Time
---------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
  SingleSource/Benchmarks/Misc/oourafft
  MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0107)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 3.9562, std.dev.: 0.0142)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3801, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000)
  SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.8564, std.dev.: 0.0151)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/simple: 133.33% (0.0120 => 0.0280, std.dev.: 0.0026)
  SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027)
  SingleSource/Regression/C/sumarray2d: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045)
  SingleSource/Benchmarks/Stanford/Quicksort: 50.00% (0.0320 => 0.0480, std.dev.: 0.0039)
  SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.21% (0.3040 => 0.3320, std.dev.: 0.0067)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 8.93% (0.2240 => 0.2440, std.dev.: 0.0045)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 8.65% (0.4160 => 0.4520, std.dev.: 0.0133)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.76% (0.3360 => 0.3520, std.dev.: 0.0050)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.55% (0.7040 => 0.7360, std.dev.: 0.0119)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.70% (0.4320 => 0.4480, std.dev.: 0.0054)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 3.30% (1.6960 => 1.7520, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.84% (1.8281 => 1.8801, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.84% (1.9721 => 2.0281, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.71% (1.9161 => 1.9681, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.64% (1.8201 => 1.8681, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.58% (1.8601 => 1.9081, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.43% (2.1361 => 2.1881, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.43% (1.8081 => 1.8521, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.25% (1.9521 => 1.9961, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.24% (1.9601 => 2.0041, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.18% (1.8361 => 1.8761, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.11% (1.8921 => 1.9321, std.dev.: 0.0113)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.95% (1.0241 => 1.0441, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.87% (1.9241 => 1.9601, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.42% (1.9761 => 2.0041, std.dev.: 0.0091)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.40% (16.3003 => 16.5283, std.dev.: 0.0543)
  MultiSource/Applications/oggenc/oggenc: 1.19% (7.0524 => 7.1364, std.dev.: 0.0123)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.72% (2.1201 => 2.4322, std.dev.: 0.0568)
  MultiSource/Benchmarks/Olden/tsp/tsp: 2.48% (1.2881 => 1.3201, std.dev.: 0.0120)
  MultiSource/Applications/minisat/minisat: 1.03% (6.5964 => 6.6644, std.dev.: 0.0245)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9442 => 3.9842, std.dev.: 0.0155)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.81% (0.6880 => 0.6480, std.dev.: 0.0057)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.85% (13.0363 => 12.6643, std.dev.: 0.0414)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.67% (94.8339 => 49.6231, std.dev.: 8.1986)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.95% (49.9431 => 32.9861, std.dev.: 0.1963)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.65% (25.7136 => 17.0611, std.dev.: 0.1550)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.0936)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.40% (37.0863 => 28.7778, std.dev.: 0.5256)
  SingleSource/Benchmarks/Linpack/linpack-pc: -14.28% (7.8165 => 6.7004, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0044)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.1563 => 5.1043, std.dev.: 0.0173)

Report Time: 1.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140220/2d51440a/attachment.html>