[llvm-testresults] pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Dec 29 04:51:08 PST 2013


http://llvm.org/perf/db_default/v4/nts/19252?compare_to=19238&baseline=18571
Nickname: pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64:28

Comparing:
     Run: 19252, Order: 198158, Start Time: 2013-12-29 08:06:25, End Time: 2013-12-29 12:55:38
      To: 19238, Order: 198146, Start Time: 2013-12-29 03:01:10, End Time: 2013-12-29 07:49:02
Baseline: 18571, Order: 197553, Start Time: 2013-12-18 09:16:57, End Time: 2013-12-18 14:35:04

===============
Tests Summary
===============

Performance Regressions: 20 (40 on baseline)
Performance Improvements: 0 (6 on baseline)
Unchanged Tests: 1090 (1064 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2005-05-13-SDivTwo: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041)
  SingleSource/Regression/C/sumarraymalloc: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042)
  MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 25.00% (0.0640 => 0.0800, std.dev.: 0.0036)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.00% (0.0480 => 0.0600, std.dev.: 0.0044)
  MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0042)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.00% (0.1000 => 0.1160, std.dev.: 0.0060)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 13.04% (0.0920 => 0.1040, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 11.63% (0.1720 => 0.1920, std.dev.: 0.0074)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 10.71% (0.1120 => 0.1240, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.11% (0.2960 => 0.3200, std.dev.: 0.0068)
  SingleSource/Benchmarks/Shootout-C++/random: 5.08% (0.2360 => 0.2480, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/strcat: 5.08% (0.2360 => 0.2480, std.dev.: 0.0041)
  MultiSource/Applications/spiff/spiff: 3.88% (1.0320 => 1.0720, std.dev.: 0.0116)
  SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.39% (1.1481 => 1.1641, std.dev.: 0.0041)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/18-imp/imp: 18.75% (0.0640 => 0.0760, std.dev.: 0.0020)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc/flops-4: 80.00% (0.0200 => 0.0360, std.dev.: 0.0048)
  SingleSource/Regression/C/sumarraymalloc: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 30.43% (0.0920 => 0.1200, std.dev.: 0.0069)
  MultiSource/Benchmarks/llubenchmark/llu: 21.43% (0.0560 => 0.0680, std.dev.: 0.0037)
  MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0042)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.00% (0.1000 => 0.1160, std.dev.: 0.0060)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 11.54% (0.1040 => 0.1160, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0056)
  SingleSource/UnitTests/Vector/constpool: 6.97% (10.3246 => 11.0447, std.dev.: 0.1185)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.14% (1.1720 => 1.2440, std.dev.: 0.0201)
  MultiSource/Applications/hbd/hbd: 4.93% (1.7040 => 1.7880, std.dev.: 0.0303)
  SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0061)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.28% (0.7480 => 0.7800, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.44% (1.1641 => 1.2041, std.dev.: 0.0070)
  MultiSource/Applications/spiff/spiff: 3.08% (1.0400 => 1.0720, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.05% (1.1801 => 1.2161, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.83% (1.1321 => 1.1641, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.78% (1.1521 => 1.1841, std.dev.: 0.0093)
  MultiSource/Benchmarks/nbench/nbench: 2.71% (1.3320 => 1.3681, std.dev.: 0.0103)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (5.2320 => 5.3680, std.dev.: 0.0354)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.59% (1.2361 => 1.2681, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.27% (1.2361 => 1.2641, std.dev.: 0.0084)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.08% (5.5800 => 5.6960, std.dev.: 0.0363)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.74% (1.1481 => 1.1681, std.dev.: 0.0070)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.72% (9.5162 => 9.6802, std.dev.: 0.0353)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.72% (16.5123 => 16.7963, std.dev.: 0.0396)
  MultiSource/Applications/JM/lencod/lencod: 1.66% (19.2805 => 19.6006, std.dev.: 0.0334)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (11.2203 => 11.4003, std.dev.: 0.0394)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.54% (1.0361 => 1.0521, std.dev.: 0.0047)
  MultiSource/Applications/oggenc/oggenc: 1.53% (6.2644 => 6.3604, std.dev.: 0.0215)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.13% (4.2323 => 4.2803, std.dev.: 0.0111)
  MultiSource/Applications/SPASS/SPASS: 1.12% (18.5724 => 18.7806, std.dev.: 0.0560)
  MultiSource/Applications/ClamAV/clamscan: 1.11% (19.0163 => 19.2283, std.dev.: 0.0561)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (5.9164 => 5.9804, std.dev.: 0.0141)
  MultiSource/Benchmarks/Bullet/bullet: 1.06% (38.5246 => 38.9326, std.dev.: 0.0879)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042)
  MultiSource/Benchmarks/llubenchmark/llu: 4.34% (5.0723 => 5.2923, std.dev.: 0.0714)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 3.33% (1.0801 => 1.1161, std.dev.: 0.0090)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -66.08% (97.4941 => 33.0661, std.dev.: 21.4417)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -66.00% (145.2571 => 49.3831, std.dev.: 29.9999)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -62.93% (46.2869 => 17.1571, std.dev.: 10.6112)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -28.97% (3.3282 => 2.3641, std.dev.: 0.1107)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -24.28% (38.3664 => 29.0498, std.dev.: 0.8445)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.82% (1.3201 => 1.2961, std.dev.: 0.0051)

Report Time: 2.30s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131229/2351c392/attachment.html>


More information about the llvm-testresults mailing list