[llvm-testresults] pollyperf5__pollyperf-O3__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jan 3 15:58:23 PST 2014


http://llvm.org/perf/db_default/v4/nts/19653?compare_to=19629&baseline=18572
Nickname: pollyperf5__pollyperf-O3__clang_DEV__x86_64:29

Comparing:
     Run: 19653, Order: 198433, Start Time: 2014-01-03 19:19:00, End Time: 2014-01-04 00:02:57
      To: 19629, Order: 198413, Start Time: 2014-01-03 14:16:23, End Time: 2014-01-03 19:00:25
Baseline: 18572, Order: 197554, Start Time: 2013-12-18 09:58:50, End Time: 2013-12-18 15:09:11

===============
Tests Summary
===============

Performance Regressions: 37 (57 on baseline)
Performance Improvements: 1 (6 on baseline)
Unchanged Tests: 1072 (1047 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-07-08-BitOpsTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout/sieve: 100.00% (0.0160 => 0.0320, std.dev.: 0.0038)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031)
  SingleSource/Regression/C/globalrefs: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041)
  SingleSource/Benchmarks/CoyoteBench/almabench: 29.41% (0.0680 => 0.0880, std.dev.: 0.0045)
  MultiSource/Benchmarks/Olden/power/power: 13.89% (0.1440 => 0.1640, std.dev.: 0.0058)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.53% (0.3040 => 0.3360, std.dev.: 0.0102)
  SingleSource/Benchmarks/McGill/chomp: 9.26% (0.2160 => 0.2360, std.dev.: 0.0057)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.11% (0.1480 => 0.1600, std.dev.: 0.0038)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.49% (0.3080 => 0.3280, std.dev.: 0.0049)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 4.72% (0.4240 => 0.4440, std.dev.: 0.0068)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 3.40% (1.4120 => 1.4600, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.32% (1.2041 => 1.2441, std.dev.: 0.0099)
  MultiSource/Applications/treecc/treecc: 3.19% (2.3840 => 2.4600, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.00% (1.2001 => 1.2361, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.72% (1.1761 => 1.2081, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.22% (1.2601 => 1.2881, std.dev.: 0.0070)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.20% (0.9081 => 0.9281, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.11% (1.1361 => 1.1601, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.06% (1.3601 => 1.3881, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.01% (1.1921 => 1.2161, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.01% (1.1961 => 1.2201, std.dev.: 0.0082)
  MultiSource/Applications/JM/ldecod/ldecod: 1.99% (7.8242 => 7.9802, std.dev.: 0.0214)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.93% (27.9737 => 28.5138, std.dev.: 0.0281)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.88% (0.8521 => 0.8681, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.68% (1.1881 => 1.2081, std.dev.: 0.0067)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.51% (3.9682 => 4.0283, std.dev.: 0.0154)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.47% (5.7244 => 5.8084, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.37% (1.1721 => 1.1881, std.dev.: 0.0061)
  MultiSource/Applications/JM/lencod/lencod: 1.27% (17.6565 => 17.8805, std.dev.: 0.0671)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.25% (8.0281 => 8.1281, std.dev.: 0.0314)
  MultiSource/Benchmarks/Bullet/bullet: 1.21% (37.0365 => 37.4846, std.dev.: 0.0783)
  MultiSource/Applications/oggenc/oggenc: 1.18% (5.7724 => 5.8404, std.dev.: 0.0203)
  MultiSource/Applications/kimwitu++/kc: 1.17% (18.7410 => 18.9610, std.dev.: 0.0361)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (10.4282 => 10.5362, std.dev.: 0.0373)
  MultiSource/Applications/sqlite3/sqlite3: 1.03% (23.6574 => 23.9015, std.dev.: 0.0483)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 11.54% (0.1040 => 0.1160, std.dev.: 0.0039)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/callargs: -66.67% (0.0240 => 0.0080, std.dev.: 0.0062)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-19-DivTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 26.67% (0.0600 => 0.0760, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc/whetstone: 21.05% (0.0760 => 0.0920, std.dev.: 0.0052)
  MultiSource/Benchmarks/McCat/15-trie/trie: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041)
  MultiSource/Applications/viterbi/viterbi: 18.18% (0.1760 => 0.2080, std.dev.: 0.0066)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/hash: 10.38% (0.4240 => 0.4680, std.dev.: 0.0056)
  MultiSource/Applications/sgefa/sgefa: 8.16% (0.3920 => 0.4240, std.dev.: 0.0072)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.49% (0.3080 => 0.3280, std.dev.: 0.0049)
  SingleSource/UnitTests/Vector/constpool: 5.25% (10.5207 => 11.0727, std.dev.: 0.1201)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.96% (0.4040 => 0.4200, std.dev.: 0.0043)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 3.82% (0.5240 => 0.5440, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.40% (1.1761 => 1.2161, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.22% (1.2441 => 1.2841, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.21% (1.1201 => 1.1561, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.06% (1.1761 => 1.2121, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.88% (1.2521 => 1.2881, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.80% (1.1441 => 1.1761, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.72% (1.1761 => 1.2081, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.66% (1.3521 => 1.3881, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.64% (1.2121 => 1.2441, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.61% (1.2241 => 1.2561, std.dev.: 0.0112)
  MultiSource/Applications/JM/ldecod/ldecod: 2.57% (7.7802 => 7.9802, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.53% (1.2641 => 1.2961, std.dev.: 0.0080)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.53% (1.4240 => 1.4600, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.41% (1.1601 => 1.1881, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.41% (1.1641 => 1.1921, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.37% (1.1801 => 1.2081, std.dev.: 0.0067)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.36% (0.8481 => 0.8681, std.dev.: 0.0048)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (27.8737 => 28.5138, std.dev.: 0.0281)
  MultiSource/Applications/d/make_dparser: 2.25% (3.7401 => 3.8241, std.dev.: 0.0242)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.21% (7.9521 => 8.1281, std.dev.: 0.0314)
  MultiSource/Applications/sqlite3/sqlite3: 2.03% (23.4254 => 23.9015, std.dev.: 0.0483)
  MultiSource/Applications/JM/lencod/lencod: 1.98% (17.5325 => 17.8805, std.dev.: 0.0671)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.98% (1.2121 => 1.2361, std.dev.: 0.0078)
  MultiSource/Applications/oggenc/oggenc: 1.96% (5.7284 => 5.8404, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.88% (1.2761 => 1.3001, std.dev.: 0.0091)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.82% (5.7044 => 5.8084, std.dev.: 0.0149)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.82% (15.1402 => 15.4162, std.dev.: 0.0482)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.79% (5.8000 => 5.9040, std.dev.: 0.0334)
  MultiSource/Benchmarks/Bullet/bullet: 1.76% (36.8365 => 37.4846, std.dev.: 0.0783)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.75% (1.1401 => 1.1601, std.dev.: 0.0062)
  MultiSource/Applications/siod/siod: 1.73% (2.5441 => 2.5881, std.dev.: 0.0144)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.72% (10.7000 => 10.8840, std.dev.: 0.0689)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.70% (10.3602 => 10.5362, std.dev.: 0.0373)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.67% (47.8409 => 48.6408, std.dev.: 0.0771)
  MultiSource/Applications/ClamAV/clamscan: 1.62% (17.2362 => 17.5162, std.dev.: 0.0659)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.62% (3.9642 => 4.0283, std.dev.: 0.0154)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.58% (2.7882 => 2.8322, std.dev.: 0.0109)
  MultiSource/Applications/kimwitu++/kc: 1.52% (18.6770 => 18.9610, std.dev.: 0.0361)
  MultiSource/Applications/SPASS/SPASS: 1.49% (17.4244 => 17.6844, std.dev.: 0.0617)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/strcat: 41.67% (0.0480 => 0.0680, std.dev.: 0.0076)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.00% (0.1000 => 0.1120, std.dev.: 0.0026)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.03% (1.1521 => 1.2561, std.dev.: 0.0065)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (3.9562 => 4.0003, std.dev.: 0.0128)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.09% (1.4721 => 1.4881, std.dev.: 0.0031)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -63.18% (46.6069 => 17.1611, std.dev.: 11.4085)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -62.28% (130.3441 => 49.1631, std.dev.: 26.6986)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -23.61% (3.1002 => 2.3681, std.dev.: 0.1176)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -21.55% (37.0343 => 29.0538, std.dev.: 0.8448)
  SingleSource/Benchmarks/McGill/chomp: -13.80% (1.0721 => 0.9241, std.dev.: 0.0072)
  MultiSource/Applications/aha/aha: -1.33% (2.7122 => 2.6762, std.dev.: 0.0024)

Report Time: 2.16s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140103/f68d7611/attachment.html>


More information about the llvm-testresults mailing list