[llvm-testresults] pollyperf2pollyperf-O3clang_DEV__x86_64 test results

Wed Dec 4 18:29:37 PST 2013

http://llvm.org/perf/db_default/v4/nts/17981?compare_to=17978&baseline=17631
Nickname: pollyperf2__pollyperf-O3__clang_DEV__x86_64:20

Comparing:
     Run: 17981, Order: 196442, Start Time: 2013-12-05 01:12:34, End Time: 2013-12-05 02:33:45
      To: 17978, Order: 196427, Start Time: 2013-12-04 23:34:07, End Time: 2013-12-05 00:55:22
Baseline: 17631, Order: 195829, Start Time: 2013-11-27 09:28:54, End Time: 2013-11-27 10:53:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 45 (48 on baseline)
Performance Improvements: 11 (17 on baseline)
Unchanged Tests: 1054 (1044 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-02-CastTest1: 300.00% (0.0040 => 0.0160, std.dev.: 0.0019)
  SingleSource/UnitTests/2002-08-02-CastTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0019)
  SingleSource/UnitTests/Threads/2010-12-08-tls: 150.00% (0.0080 => 0.0200, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/hello: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038)
  SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0160 => 0.0320, std.dev.: 0.0019)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0160 => 0.0320, std.dev.: 0.0019)
  SingleSource/UnitTests/stmtexpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
  SingleSource/Regression/C/globalrefs: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/lowercase: 60.00% (0.0200 => 0.0320, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/objinst: 27.27% (0.0440 => 0.0560, std.dev.: 0.0019)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.22% (0.0720 => 0.0880, std.dev.: 0.0000)
  SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0000)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 17.65% (0.0680 => 0.0800, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.67% (0.0960 => 0.1120, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.79% (0.0760 => 0.0880, std.dev.: 0.0033)
  MultiSource/Applications/viterbi/viterbi: 12.77% (0.1880 => 0.2120, std.dev.: 0.0019)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 9.09% (0.1760 => 0.1920, std.dev.: 0.0019)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 8.57% (0.1400 => 0.1520, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/sieve: 7.50% (0.3200 => 0.3440, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2200 => 0.2360, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057)
  SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.91% (0.7440 => 0.7880, std.dev.: 0.0124)
  SingleSource/Benchmarks/Shootout-C++/lists1: 5.88% (0.3400 => 0.3600, std.dev.: 0.0050)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.00% (0.2400 => 0.2520, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/matrix: 4.48% (0.2680 => 0.2800, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.38% (1.0960 => 1.1440, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.2880 => 0.3000, std.dev.: 0.0033)
  MultiSource/Applications/sgefa/sgefa: 3.96% (0.4040 => 0.4200, std.dev.: 0.0050)
  MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3400 => 0.3520, std.dev.: 0.0038)
  MultiSource/Benchmarks/McCat/05-eks/eks: 3.51% (0.6840 => 0.7080, std.dev.: 0.0057)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.69% (1.1880 => 1.2200, std.dev.: 0.0065)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.65% (1.5120 => 1.5520, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.88% (1.2761 => 1.3001, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.69% (0.9441 => 0.9601, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.30% (1.2321 => 1.2481, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.26% (1.2721 => 1.2881, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.05% (1.1401 => 1.1521, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.51% (0.1880 => 0.2040)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 8.16% (0.1960 => 0.2120, std.dev.: 0.0050)
  MultiSource/Applications/spiff/spiff: 4.53% (2.0321 => 2.1241, std.dev.: 0.0312)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.91% (5.6404 => 5.7484, std.dev.: 0.0124)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.71% (4.6683 => 4.7483, std.dev.: 0.0310)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.68% (3.5722 => 3.6322, std.dev.: 0.0115)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/FloatPrecision: -50.00% (0.0240 => 0.0120, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -30.00% (0.0400 => 0.0280, std.dev.: 0.0033)
  SingleSource/UnitTests/initp1: -26.67% (0.0600 => 0.0440, std.dev.: 0.0050)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -10.00% (0.4400 => 0.3960, std.dev.: 0.0068)
  MultiSource/Benchmarks/McCat/18-imp/imp: -8.11% (0.4440 => 0.4080, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.05% (1.1801 => 1.1441, std.dev.: 0.0050)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -2.56% (1.4040 => 1.3680, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.32% (1.2161 => 1.2001, std.dev.: 0.0019)
  MultiSource/Applications/ClamAV/clamscan: -1.29% (17.3082 => 17.0842, std.dev.: 0.0446)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -2.49% (1.4441 => 1.4081, std.dev.: 0.0105)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.1281 => 1.1161, std.dev.: 0.0019)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.35% (0.2720 => 0.2920, std.dev.: 0.0065)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2007-04-25-weak: 300.00% (0.0040 => 0.0160, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/hello: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038)
  SingleSource/UnitTests/2003-08-20-FoldBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0000)
  SingleSource/UnitTests/2007-01-04-KNR-Args: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
  SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0120 => 0.0240, std.dev.: 0.0000)
  SingleSource/UnitTests/stmtexpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 46.67% (0.0600 => 0.0880, std.dev.: 0.0033)
  SingleSource/Regression/C/casts: 30.00% (0.0400 => 0.0520, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.00% (0.0800 => 0.1000, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 21.74% (0.0920 => 0.1120, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.05% (0.0760 => 0.0920, std.dev.: 0.0050)
  SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/strcat: 14.55% (0.2200 => 0.2520, std.dev.: 0.0050)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 12.82% (0.1560 => 0.1760, std.dev.: 0.0050)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.00% (0.1000 => 0.1120, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.34% (0.3480 => 0.3840, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2200 => 0.2360, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2200 => 0.2360, std.dev.: 0.0050)
  SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0033)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 6.67% (0.1800 => 0.1920, std.dev.: 0.0019)
  MultiSource/Applications/viterbi/viterbi: 6.00% (0.2000 => 0.2120, std.dev.: 0.0019)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.71% (0.2800 => 0.2960, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2480 => 0.2600, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.4840 => 1.5520, std.dev.: 0.0113)
  SingleSource/Benchmarks/Shootout-C++/matrix: 4.48% (0.2680 => 0.2800, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.14% (0.6760 => 0.7040, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.17% (1.1361 => 1.1721, std.dev.: 0.0019)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.91% (0.6880 => 0.7080, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.88% (1.2761 => 1.3001, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.70% (1.1761 => 1.1961, std.dev.: 0.0065)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.69% (0.9441 => 0.9601, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.58% (1.2681 => 1.2881, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.57% (1.2761 => 1.2961, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.40% (1.1441 => 1.1601, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.37% (1.1681 => 1.1841, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.30% (1.2321 => 1.2481, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.19% (1.3441 => 1.3601, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: 33.33% (0.0480 => 0.0640)
  SingleSource/Benchmarks/Shootout-C++/strcat: 28.57% (0.0560 => 0.0720, std.dev.: 0.0057)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.45% (0.1760 => 0.2120, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 16.67% (0.1680 => 0.1960, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/strcat: 11.76% (0.1360 => 0.1520, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.39% (0.3160 => 0.3520, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.25% (0.1920 => 0.2040)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 6.02% (1.3281 => 1.4081, std.dev.: 0.0105)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.52% (0.4760 => 0.4880)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.32% (2.4282 => 2.4602, std.dev.: 0.0038)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/ms_struct-bitfield-1: -100.00% (0.0160 => 0.0000, std.dev.: 0.0050)
  SingleSource/Regression/C/2003-06-16-InvalidInitializer: -75.00% (0.0160 => 0.0040, std.dev.: 0.0033)
  SingleSource/UnitTests/2003-05-02-DependentPHI: -42.86% (0.0280 => 0.0160, std.dev.: 0.0038)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -29.41% (0.0680 => 0.0480, std.dev.: 0.0068)
  SingleSource/UnitTests/initp1: -26.67% (0.0600 => 0.0440, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -14.58% (0.1920 => 0.1640, std.dev.: 0.0068)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -13.04% (0.0920 => 0.0800, std.dev.: 0.0038)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -5.71% (0.4200 => 0.3960, std.dev.: 0.0068)
  MultiSource/Benchmarks/McCat/18-imp/imp: -5.56% (0.4320 => 0.4080, std.dev.: 0.0075)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -3.27% (1.9560 => 1.8920, std.dev.: 0.0217)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.89% (2.5402 => 2.4922, std.dev.: 0.0086)
  SingleSource/Benchmarks/Misc-C++/bigfib: -1.68% (0.7160 => 0.7040, std.dev.: 0.0038)
  MultiSource/Applications/ClamAV/clamscan: -1.52% (17.3482 => 17.0842, std.dev.: 0.0446)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -5.76% (4.2403 => 3.9962, std.dev.: 0.0785)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.91% (0.6280 => 0.6160, std.dev.: 0.0033)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -1.76% (1.1361 => 1.1161, std.dev.: 0.0019)
  MultiSource/Applications/minisat/minisat: -1.30% (6.7684 => 6.6804, std.dev.: 0.0272)

Report Time: 0.69s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131204/32dd0a81/attachment.html>

[llvm-testresults] pollyperf2__pollyperf-O3__clang_DEV__x86_64 test results

[llvm-testresults] pollyperf2pollyperf-O3clang_DEV__x86_64 test results