[llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results

Tue Feb 18 16:14:01 PST 2014

http://llvm.org/perf/db_default/v4/nts/22417?compare_to=21511&baseline=21467
Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38

Comparing:
     Run: 22417, Order: 201593, Start Time: 2014-02-18 19:17:45, End Time: 2014-02-19 00:19:30
      To: 21511, Order: 200427, Start Time: 2014-01-29 23:30:22, End Time: 2014-01-30 04:17:13
Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53

===============
Tests Summary
===============

New Passes: 2 (11 on baseline)
Performance Regressions: 35 (23 on baseline)
Performance Improvements: 6 (11 on baseline)
Unchanged Tests: 1067 (1065 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

New Passes - Compile Time
-------------------------
  SingleSource/Benchmarks/Misc/oourafft
  SingleSource/Benchmarks/Misc/oourafft: 747.26% (11.3247 => 95.9500, std.dev.: 0.1717)

New Passes - Execution Time
---------------------------
  SingleSource/Benchmarks/Misc/oourafft
  SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.8484, std.dev.: 0.0138)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/global_ctor: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 62.50% (0.0320 => 0.0520, std.dev.: 0.0073)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 40.00% (0.0600 => 0.0840, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc/richards_benchmark: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042)
  MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0092)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.71% (0.1120 => 0.1240, std.dev.: 0.0038)
  MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 7.02% (0.2280 => 0.2440, std.dev.: 0.0047)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 6.90% (0.2320 => 0.2480, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.76% (0.3360 => 0.3520, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.11% (0.2920 => 0.3040, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.04% (1.8401 => 1.8961, std.dev.: 0.0100)
  MultiSource/Applications/minisat/minisat: 2.86% (0.8400 => 0.8640, std.dev.: 0.0078)
  MultiSource/Applications/obsequi/Obsequi: 2.62% (1.8320 => 1.8800, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.58% (2.0161 => 2.0681, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.54% (1.8881 => 1.9361, std.dev.: 0.0072)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.49% (1.7641 => 1.8081, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.49% (2.0921 => 2.1441, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.46% (1.9521 => 2.0001, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.42% (1.8201 => 1.8641, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.27% (1.9401 => 1.9841, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.21% (1.8121 => 1.8521, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.08% (1.9201 => 1.9601, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.02% (1.9761 => 2.0161, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.00% (1.7961 => 1.8321, std.dev.: 0.0126)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.89% (5.2960 => 5.3960, std.dev.: 0.0338)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.74% (1.8401 => 1.8721, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.66% (1.9241 => 1.9561, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.51% (2.1161 => 2.1481, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.48% (1.8921 => 1.9201, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.31% (2.1441 => 2.1721, std.dev.: 0.0098)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.12% (6.0804 => 6.1484, std.dev.: 0.0206)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.10% (2.1121 => 2.4522, std.dev.: 0.0638)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -12.77% (0.1880 => 0.1640, std.dev.: 0.0067)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.85% (0.6840 => 0.6440, std.dev.: 0.0044)
  SingleSource/Benchmarks/Stanford/Puzzle: -4.50% (0.4440 => 0.4240, std.dev.: 0.0062)
  MultiSource/Benchmarks/mafft/pairlocalalign: -3.23% (13.0083 => 12.5883, std.dev.: 0.0331)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -14.18% (7.8165 => 6.7084, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0059)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Compile Time
-------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/7zip/7zip-benchmark
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
  SingleSource/Benchmarks/Misc/oourafft
  MultiSource/Applications/ClamAV/clamscan: 8.22% (17.6723 => 19.1243, std.dev.: 0.0671)
  MultiSource/Applications/sqlite3/sqlite3: 1408.95% (1.7001 => 25.6536, std.dev.: 0.0211)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 0.23% (50.1010 => 50.2170, std.dev.: 0.1126)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.80% (1.0520 => 1.0120, std.dev.: 0.0448)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.16% (11.3920 => 11.5240, std.dev.: 0.0827)
  SingleSource/Benchmarks/Misc/oourafft: 746.07% (11.3407 => 95.9500, std.dev.: 0.1717)

New Passes - Execution Time
---------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
  SingleSource/Benchmarks/Misc/oourafft
  MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0074)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 3.9562, std.dev.: 0.0178)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3761, std.dev.: 0.0039)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000)
  SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.8484, std.dev.: 0.0138)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0022)
  SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0045)
  MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0092)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.76% (0.3360 => 0.3520, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.11% (0.2920 => 0.3040, std.dev.: 0.0041)
  SingleSource/UnitTests/Vector/constpool: 4.04% (10.4007 => 10.8207, std.dev.: 0.1589)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.56% (0.4680 => 0.4800, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.41% (1.8281 => 1.8721, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.30% (1.9161 => 1.9601, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.23% (1.9721 => 2.0161, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.16% (1.8561 => 1.8961, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.04% (1.9601 => 2.0001, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.97% (2.0281 => 2.0681, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.69% (2.1361 => 2.1721, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.66% (1.9241 => 1.9561, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.52% (1.8361 => 1.8641, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.48% (1.8921 => 1.9201, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.26% (1.9121 => 1.9361, std.dev.: 0.0072)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.66% (2.1201 => 2.4522, std.dev.: 0.0638)
  MultiSource/Benchmarks/Olden/power/power: 1.74% (1.3801 => 1.4041, std.dev.: 0.0026)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/whetstone: -10.53% (0.1520 => 0.1360, std.dev.: 0.0061)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.40% (0.6880 => 0.6440, std.dev.: 0.0044)
  SingleSource/Benchmarks/McGill/chomp: -6.35% (0.2520 => 0.2360, std.dev.: 0.0051)
  MultiSource/Benchmarks/mafft/pairlocalalign: -3.44% (13.0363 => 12.5883, std.dev.: 0.0331)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.53% (94.8339 => 49.7591, std.dev.: 6.8530)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.54% (25.7136 => 17.0891, std.dev.: 0.2396)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.34% (49.9431 => 33.2901, std.dev.: 0.3209)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -16.01% (3.0722 => 2.5802, std.dev.: 0.1095)
  SingleSource/Benchmarks/Linpack/linpack-pc: -14.18% (7.8165 => 6.7084, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0059)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0122)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140218/d9f15f22/attachment.html>