[llvm-testresults] pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Jan 4 13:35:16 PST 2014


http://llvm.org/perf/db_default/v4/nts/19685?compare_to=19673&baseline=18571
Nickname: pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64:28

Comparing:
     Run: 19685, Order: 198502, Start Time: 2014-01-04 16:54:29, End Time: 2014-01-04 21:39:51
      To: 19673, Order: 198480, Start Time: 2014-01-04 11:50:41, End Time: 2014-01-04 16:36:39
Baseline: 18571, Order: 197553, Start Time: 2013-12-18 09:16:57, End Time: 2013-12-18 14:35:04

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 12 (28 on baseline)
Performance Improvements: 1 (7 on baseline)
Existing Failures: 2 (0 on baseline)
Unchanged Tests: 1095 (1073 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045)
  SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 18.52% (0.1080 => 0.1280, std.dev.: 0.0055)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.16% (0.2960 => 0.3320, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.81% (0.3440 => 0.3640, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 4.92% (0.2440 => 0.2560, std.dev.: 0.0045)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.09% (0.6840 => 0.7120, std.dev.: 0.0084)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.28% (0.4880 => 0.5040, std.dev.: 0.0037)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.55% (0.6280 => 0.6440, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.63% (1.2281 => 1.2481, std.dev.: 0.0075)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.04% (9.5842 => 9.6842, std.dev.: 0.0236)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -18.18% (0.0880 => 0.0720, std.dev.: 0.0060)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/JM/lencod/lencod: -0.06% (19.4206 => 19.4086, std.dev.: 0.0445)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/JM/lencod/lencod: - (0.0000 => 0.0000)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Compile Time
---------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/JM/lencod/lencod: 0.66% (19.2805 => 19.4086, std.dev.: 0.0445)

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/JM/lencod/lencod: -100.00% (8.1325 => 0.0000)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/PR491: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/flops-4: 100.00% (0.0200 => 0.0400, std.dev.: 0.0049)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.79% (0.3080 => 0.3320, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc/ReedSolomon: 6.90% (0.2320 => 0.2480, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0045)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.45% (0.2480 => 0.2640, std.dev.: 0.0045)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.14% (1.1720 => 1.2440, std.dev.: 0.0224)
  SingleSource/UnitTests/Vector/constpool: 5.62% (10.3246 => 10.9047, std.dev.: 0.1312)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.21% (1.1201 => 1.1561, std.dev.: 0.0102)
  MultiSource/Benchmarks/sim/sim: 3.03% (0.3960 => 0.4080, std.dev.: 0.0037)
  MultiSource/Applications/lemon/lemon: 2.43% (1.4801 => 1.5161, std.dev.: 0.0047)
  MultiSource/Benchmarks/nbench/nbench: 2.41% (1.3320 => 1.3641, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.37% (1.3521 => 1.3841, std.dev.: 0.0103)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.08% (5.5800 => 5.6960, std.dev.: 0.0163)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.03% (11.2203 => 11.4483, std.dev.: 0.0371)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.99% (1.2081 => 1.2321, std.dev.: 0.0080)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.90% (0.6320 => 0.6440, std.dev.: 0.0043)
  MultiSource/Applications/sqlite3/sqlite3: 1.78% (24.2975 => 24.7295, std.dev.: 0.0504)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.77% (9.5162 => 9.6842, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.63% (1.2281 => 1.2481, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.58% (1.2641 => 1.2841, std.dev.: 0.0072)
  MultiSource/Applications/SPASS/SPASS: 1.55% (18.5724 => 18.8606, std.dev.: 0.0547)
  MultiSource/Benchmarks/Bullet/bullet: 1.53% (38.5246 => 39.1126, std.dev.: 0.0752)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.51% (4.2323 => 4.2963, std.dev.: 0.0094)
  MultiSource/Applications/JM/ldecod/ldecod: 1.46% (8.5002 => 8.6243, std.dev.: 0.0424)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.40% (28.9458 => 29.3498, std.dev.: 0.0871)
  MultiSource/Applications/ClamAV/clamscan: 1.20% (19.0163 => 19.2443, std.dev.: 0.0433)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -66.18% (97.4941 => 32.9741, std.dev.: 21.0777)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -66.05% (145.2571 => 49.3191, std.dev.: 26.5677)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -63.03% (46.2869 => 17.1131, std.dev.: 10.6900)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -28.73% (3.3282 => 2.3721, std.dev.: 0.1108)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -25.17% (38.3664 => 28.7098, std.dev.: 0.7469)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.90% (2.6842 => 2.4722, std.dev.: 0.0791)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.42% (1.3201 => 1.2881, std.dev.: 0.0095)

Report Time: 2.06s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140104/4a5e728b/attachment.html>


More information about the llvm-testresults mailing list