[llvm-testresults] pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Dec 18 22:27:29 PST 2013


http://llvm.org/perf/db_default/v4/nts/18614?compare_to=18601&baseline=18571
Nickname: pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64:28

Comparing:
     Run: 18614, Order: 197640, Start Time: 2013-12-19 01:31:59, End Time: 2013-12-19 06:31:47
      To: 18601, Order: 197602, Start Time: 2013-12-18 20:14:09, End Time: 2013-12-19 01:14:44
Baseline: 18571, Order: 197553, Start Time: 2013-12-18 09:16:57, End Time: 2013-12-18 14:35:04

===============
Tests Summary
===============

Performance Regressions: 12 (18 on baseline)
Performance Improvements: 2 (8 on baseline)
Unchanged Tests: 1096 (1084 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028)
  SingleSource/UnitTests/2003-05-07-VarArgs: 80.00% (0.0200 => 0.0360, std.dev.: 0.0053)
  SingleSource/Benchmarks/Stanford/Oscar: 31.25% (0.0640 => 0.0840, std.dev.: 0.0031)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 30.00% (0.0800 => 0.1040, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 9.09% (0.7480 => 0.8160, std.dev.: 0.0098)
  MultiSource/Applications/hexxagon/hexxagon: 2.80% (1.1440 => 1.1760, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.31% (1.2121 => 1.2401, std.dev.: 0.0059)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Treesort: 41.67% (0.0480 => 0.0680, std.dev.: 0.0045)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.59% (4.5243 => 4.5963, std.dev.: 0.0221)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.37% (1.4601 => 1.4801, std.dev.: 0.0062)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/ffbench: -17.86% (0.1120 => 0.0920, std.dev.: 0.0073)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.5682 => 3.5322, std.dev.: 0.0129)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/fib2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/flops-4: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045)
  SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.81% (0.0840 => 0.1040, std.dev.: 0.0042)
  SingleSource/Benchmarks/McGill/exptree: 18.18% (0.0880 => 0.1040, std.dev.: 0.0059)
  SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 6.67% (0.2400 => 0.2560, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.56% (0.2880 => 0.3040, std.dev.: 0.0045)
  SingleSource/UnitTests/Vector/constpool: 5.31% (10.3246 => 10.8727, std.dev.: 0.1613)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.08% (1.1521 => 1.1761, std.dev.: 0.0074)
  MultiSource/Applications/hexxagon/hexxagon: 1.73% (1.1560 => 1.1760, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.64% (1.2201 => 1.2401, std.dev.: 0.0059)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.29% (5.5800 => 5.6520, std.dev.: 0.0219)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.12% (11.4520 => 11.5800, std.dev.: 0.0392)
  MultiSource/Applications/lemon/lemon: 1.08% (1.4801 => 1.4961, std.dev.: 0.0048)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (0.2440 => 0.2560, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.50% (4.5283 => 4.5963, std.dev.: 0.0221)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2003-05-31-CastToBool: -50.00% (0.0320 => 0.0160, std.dev.: 0.0060)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -65.72% (97.4941 => 33.4221, std.dev.: 14.0329)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -65.49% (145.2571 => 50.1271, std.dev.: 21.1166)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -62.35% (46.2869 => 17.4251, std.dev.: 7.3704)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -27.04% (3.3282 => 2.4282, std.dev.: 0.1497)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.42% (1.3201 => 1.2881, std.dev.: 0.0086)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.45% (1.1041 => 1.0881, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout-C++/ary3: -1.12% (3.5722 => 3.5322, std.dev.: 0.0129)

Report Time: 1.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131219/e9ca4fe9/attachment.html>


More information about the llvm-testresults mailing list