[llvm-testresults] pollyperf3__pollyperf-O3__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 23 20:44:42 PST 2013


http://llvm.org/perf/db_default/v4/nts/18924?compare_to=18904&baseline=18569
Nickname: pollyperf3__pollyperf-O3__clang_DEV__x86_64:26

Comparing:
     Run: 18924, Order: 197926, Start Time: 2013-12-24 00:00:08, End Time: 2013-12-24 04:49:07
      To: 18904, Order: 197913, Start Time: 2013-12-23 18:10:40, End Time: 2013-12-23 23:00:40
Baseline: 18569, Order: 197553, Start Time: 2013-12-18 09:17:34, End Time: 2013-12-18 14:27:44

===============
Tests Summary
===============

Performance Regressions: 16 (24 on baseline)
Performance Improvements: 0 (5 on baseline)
Unchanged Tests: 1094 (1081 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/PR10189: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045)
  SingleSource/UnitTests/SignlessTypes/ccc: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 62.50% (0.0320 => 0.0520, std.dev.: 0.0064)
  MultiSource/Benchmarks/FreeBench/distray/distray: 24.00% (0.1000 => 0.1240, std.dev.: 0.0052)
  SingleSource/Benchmarks/CoyoteBench/almabench: 23.53% (0.0680 => 0.0840, std.dev.: 0.0041)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.39% (0.0920 => 0.1080, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 15.00% (0.0800 => 0.0920, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.22% (1.2601 => 1.2881, std.dev.: 0.0054)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.45% (5.8080 => 5.8920, std.dev.: 0.0215)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/lemon/lemon: 5.81% (0.9641 => 1.0201, std.dev.: 0.0172)
  SingleSource/Benchmarks/Shootout-C++/hash: 5.60% (0.5000 => 0.5280, std.dev.: 0.0086)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0118)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.18% (1.1321 => 1.1681, std.dev.: 0.0136)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.70% (0.5920 => 0.6080, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.23% (4.4843 => 4.5843, std.dev.: 0.0347)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/ccc: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout/methcall: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040)
  SingleSource/UnitTests/Vector/build2: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033)
  SingleSource/Benchmarks/Dhrystone/dry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0045)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout/lists: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.39% (0.0920 => 0.1080, std.dev.: 0.0058)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 11.11% (0.1080 => 0.1200, std.dev.: 0.0035)
  SingleSource/UnitTests/Vector/constpool: 5.38% (10.3446 => 10.9007, std.dev.: 0.1873)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 3.07% (1.6960 => 1.7480, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.69% (1.1881 => 1.2201, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.55% (1.2561 => 1.2881, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.43% (1.1521 => 1.1801, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.31% (1.2121 => 1.2401, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.03% (1.1801 => 1.2041, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.96% (1.2241 => 1.2481, std.dev.: 0.0091)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.41% (2.5522 => 2.5882, std.dev.: 0.0112)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.38% (5.8120 => 5.8920, std.dev.: 0.0215)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.7962 => 2.8322, std.dev.: 0.0075)
  MultiSource/Applications/kimwitu++/kc: 1.18% (18.6290 => 18.8490, std.dev.: 0.0289)
  MultiSource/Applications/ClamAV/clamscan: 1.12% (17.2162 => 17.4082, std.dev.: 0.0445)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.15% (0.7160 => 0.7600, std.dev.: 0.0118)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.88% (4.6883 => 4.7763, std.dev.: 0.0340)
  MultiSource/Applications/minisat/minisat: 1.46% (6.5684 => 6.6644, std.dev.: 0.0281)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -64.53% (139.6807 => 49.5471, std.dev.: 25.6204)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -63.06% (89.9296 => 33.2221, std.dev.: 19.7727)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -24.27% (3.1642 => 2.3961, std.dev.: 0.0837)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -21.95% (37.3983 => 29.1898, std.dev.: 0.6401)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -9.72% (0.2880 => 0.2600, std.dev.: 0.0102)

Report Time: 2.31s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131223/fa59fb72/attachment.html>


More information about the llvm-testresults mailing list