[llvm-testresults] pollyperf2__pollyperf-O3__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Dec 20 12:55:27 PST 2013


http://llvm.org/perf/db_default/v4/nts/18738?compare_to=18711&baseline=17631
Nickname: pollyperf2__pollyperf-O3__clang_DEV__x86_64:20

Comparing:
     Run: 18738, Order: 197815, Start Time: 2013-12-20 16:09:46, End Time: 2013-12-20 20:59:46
      To: 18711, Order: 197787, Start Time: 2013-12-20 08:24:24, End Time: 2013-12-20 13:15:14
Baseline: 17631, Order: 195829, Start Time: 2013-11-27 09:28:54, End Time: 2013-11-27 10:53:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 8 (15 on baseline)
Performance Improvements: 2 (28 on baseline)
Unchanged Tests: 1100 (1066 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/globalrefs: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035)
  SingleSource/Regression/C/casts: 66.67% (0.0240 => 0.0400, std.dev.: 0.0051)
  SingleSource/UnitTests/Vector/multiplies: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: 33.33% (0.0480 => 0.0640, std.dev.: 0.0047)
  SingleSource/Benchmarks/Misc/fbench: 18.75% (0.0640 => 0.0760, std.dev.: 0.0036)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.91% (1.1000 => 1.1320, std.dev.: 0.0091)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/strcat: 12.50% (0.1280 => 0.1440, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.24% (3.8722 => 3.9202, std.dev.: 0.0076)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.79% (1.1601 => 1.1161, std.dev.: 0.0134)
  MultiSource/Applications/lemon/lemon: -1.45% (1.3761 => 1.3561, std.dev.: 0.0073)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.94% (0.2720 => 0.2640, std.dev.: 0.0144)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 40.00% (0.0600 => 0.0840, std.dev.: 0.0057)
  MultiSource/Applications/sqlite3/sqlite3: 36.60% (17.1050 => 23.3654, std.dev.: 0.0271)
  MultiSource/Benchmarks/McCat/15-trie/trie: 21.43% (0.0560 => 0.0680, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.96% (0.3760 => 0.4360, std.dev.: 0.0139)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.42% (25.1416 => 27.7617, std.dev.: 0.0491)
  MultiSource/Applications/lemon/lemon: 9.00% (1.2441 => 1.3561, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.46% (5.3640 => 5.7640, std.dev.: 0.0447)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.82% (5.4960 => 5.8160, std.dev.: 0.0294)
  MultiSource/Applications/oggenc/oggenc: 3.48% (5.5123 => 5.7044, std.dev.: 0.0190)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.05% (47.3607 => 47.8569, std.dev.: 0.0657)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.86% (0.3160 => 0.3440, std.dev.: 0.0078)
  MultiSource/Applications/siod/siod: 2.56% (2.8162 => 2.8882, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.88% (4.0363 => 4.1123, std.dev.: 0.0028)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.63% (0.7360 => 0.7480, std.dev.: 0.0033)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.32% (2.4282 => 2.4602, std.dev.: 0.0026)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/2003-06-16-InvalidInitializer: -75.00% (0.0160 => 0.0040, std.dev.: 0.0041)
  SingleSource/UnitTests/2003-05-02-DependentPHI: -42.86% (0.0280 => 0.0160, std.dev.: 0.0045)
  SingleSource/Regression/C/matrixTranspose: -37.50% (0.0320 => 0.0200, std.dev.: 0.0026)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -37.50% (0.0320 => 0.0200, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -28.57% (0.0840 => 0.0600, std.dev.: 0.0078)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -23.53% (0.0680 => 0.0520, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout/objinst: -21.43% (0.0560 => 0.0440, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -20.83% (0.1920 => 0.1520, std.dev.: 0.0095)
  SingleSource/Benchmarks/Misc/richards_benchmark: -17.39% (0.0920 => 0.0760, std.dev.: 0.0060)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -17.39% (0.0920 => 0.0760, std.dev.: 0.0053)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.15% (0.2640 => 0.2240, std.dev.: 0.0109)
  SingleSource/Benchmarks/Misc/flops: -13.79% (0.1160 => 0.1000, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -13.04% (0.0920 => 0.0800, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.89% (6.0924 => 5.6724, std.dev.: 0.0254)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.40% (1.4560 => 1.3920, std.dev.: 0.0186)
  SingleSource/Benchmarks/Shootout-C++/hash2: -3.97% (0.5040 => 0.4840, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.79% (1.1601 => 1.1161, std.dev.: 0.0134)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.56% (0.4680 => 0.4560, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.99% (1.2041 => 1.1801, std.dev.: 0.0084)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.10% (15.2402 => 15.0722, std.dev.: 0.0582)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -27.27% (0.0440 => 0.0320, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -8.21% (4.2403 => 3.8922, std.dev.: 0.0994)
  MultiSource/Applications/sgefa/sgefa: -2.26% (0.5320 => 0.5200, std.dev.: 0.0032)
  MultiSource/Applications/SPASS/SPASS: -1.88% (9.3406 => 9.1646, std.dev.: 0.0254)
  MultiSource/Applications/minisat/minisat: -1.65% (6.7684 => 6.6564, std.dev.: 0.0286)
  MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3441 => 1.3241, std.dev.: 0.0070)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.04% (5.0043 => 4.9523, std.dev.: 0.0193)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.4762 => 3.4402, std.dev.: 0.0117)

Report Time: 2.62s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131220/aaeccfdf/attachment.html>


More information about the llvm-testresults mailing list