[llvm-testresults] pollyperf3__pollyperf-O3__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 30 06:36:27 PST 2013


http://llvm.org/perf/db_default/v4/nts/19335?compare_to=19323&baseline=18569
Nickname: pollyperf3__pollyperf-O3__clang_DEV__x86_64:26

Comparing:
     Run: 19335, Order: 198208, Start Time: 2013-12-30 09:56:22, End Time: 2013-12-30 14:40:56
      To: 19323, Order: 198200, Start Time: 2013-12-30 04:32:31, End Time: 2013-12-30 09:16:52
Baseline: 18569, Order: 197553, Start Time: 2013-12-18 09:17:34, End Time: 2013-12-18 14:27:44

===============
Tests Summary
===============

Performance Regressions: 13 (46 on baseline)
Performance Improvements: 2 (5 on baseline)
Unchanged Tests: 1095 (1059 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/AtomicOps: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041)
  SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/flops-6: 42.86% (0.0280 => 0.0400, std.dev.: 0.0024)
  SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 25.00% (0.0640 => 0.0800, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.22% (0.0720 => 0.0880, std.dev.: 0.0059)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.26% (0.4360 => 0.4720, std.dev.: 0.0098)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.80% (0.2760 => 0.2920, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.62% (1.2321 => 1.2521, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.57% (1.2721 => 1.2921, std.dev.: 0.0067)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.38% (6.0840 => 6.1680, std.dev.: 0.0261)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: -80.00% (0.0200 => 0.0040, std.dev.: 0.0059)
  SingleSource/Benchmarks/Misc/richards_benchmark: -28.57% (0.0840 => 0.0600, std.dev.: 0.0093)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl: 400.00% (0.0040 => 0.0200, std.dev.: 0.0044)
  SingleSource/UnitTests/2007-01-04-KNR-Args: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038)
  SingleSource/UnitTests/printargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024)
  SingleSource/UnitTests/2006-02-04-DivRem: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036)
  SingleSource/UnitTests/2006-01-23-UnionInit: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035)
  SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/bisort/bisort: 26.67% (0.0600 => 0.0760, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041)
  MultiSource/Applications/viterbi/viterbi: 13.64% (0.1760 => 0.2000, std.dev.: 0.0086)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 12.20% (0.1640 => 0.1840, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/sieve: 10.53% (0.3040 => 0.3360, std.dev.: 0.0082)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.26% (0.4320 => 0.4720, std.dev.: 0.0098)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2200 => 0.2360, std.dev.: 0.0060)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.80% (0.2760 => 0.2920, std.dev.: 0.0051)
  SingleSource/Benchmarks/Linpack/linpack-pc: 5.19% (0.3080 => 0.3240, std.dev.: 0.0058)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.88% (0.6560 => 0.6880, std.dev.: 0.0113)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.52% (1.3640 => 1.4120, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.87% (1.2561 => 1.2921, std.dev.: 0.0067)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 2.83% (1.6960 => 1.7440, std.dev.: 0.0174)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.69% (1.1881 => 1.2201, std.dev.: 0.0120)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.37% (1.5200 => 1.5560, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.29% (1.2201 => 1.2481, std.dev.: 0.0095)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.25% (6.0320 => 6.1680, std.dev.: 0.0261)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.08% (1.1521 => 1.1761, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.04% (1.1761 => 1.2001, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.99% (1.2041 => 1.2281, std.dev.: 0.0088)
  MultiSource/Applications/ClamAV/clamscan: 1.70% (17.2162 => 17.5082, std.dev.: 0.0828)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.69% (1.1841 => 1.2041, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.68% (1.1881 => 1.2081, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.62% (1.2321 => 1.2521, std.dev.: 0.0069)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.53% (15.1202 => 15.3522, std.dev.: 0.0480)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.45% (7.9761 => 8.0921, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.42% (1.1241 => 1.1401, std.dev.: 0.0062)
  MultiSource/Applications/oggenc/oggenc: 1.39% (5.7404 => 5.8204, std.dev.: 0.0209)
  MultiSource/Applications/JM/ldecod/ldecod: 1.34% (7.7762 => 7.8802, std.dev.: 0.0209)
  MultiSource/Applications/kimwitu++/kc: 1.29% (18.6290 => 18.8690, std.dev.: 0.0544)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.7962 => 2.8322, std.dev.: 0.0109)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.25% (2.5522 => 2.5842, std.dev.: 0.0114)
  MultiSource/Applications/sqlite3/sqlite3: 1.22% (23.3734 => 23.6574, std.dev.: 0.0410)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (3.9682 => 4.0163, std.dev.: 0.0103)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (10.3202 => 10.4442, std.dev.: 0.0330)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.12% (5.6964 => 5.7604, std.dev.: 0.0170)
  MultiSource/Applications/SPASS/SPASS: 1.08% (17.4484 => 17.6364, std.dev.: 0.0727)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.06% (27.8657 => 28.1618, std.dev.: 0.0432)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/minisat/minisat: 2.19% (6.5684 => 6.7124, std.dev.: 0.0290)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.40% (0.8561 => 0.8681, std.dev.: 0.0026)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -64.75% (139.6807 => 49.2351, std.dev.: 30.8187)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -63.24% (89.9296 => 33.0541, std.dev.: 21.4529)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -25.41% (3.1642 => 2.3601, std.dev.: 0.1135)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.23% (37.3983 => 29.0858, std.dev.: 0.8525)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4522 => 2.4242, std.dev.: 0.0091)

Report Time: 2.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131230/ebf31026/attachment.html>


More information about the llvm-testresults mailing list