[llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results

Fri Jan 24 13:02:33 PST 2014

http://llvm.org/perf/db_default/v4/nts/21242?compare_to=21230&baseline=19898
Nickname: pollyperf-O3__clang_DEV__x86_64:34

Comparing:
     Run: 21242, Order: 200013, Start Time: 2014-01-24 16:25:28, End Time: 2014-01-24 21:07:33
      To: 21230, Order: 199992, Start Time: 2014-01-24 13:03:07, End Time: 2014-01-24 17:51:20
Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29

===============
Tests Summary
===============

Performance Regressions: 25 (21 on baseline)
Performance Improvements: 0 (4 on baseline)
Unchanged Tests: 1085 (1085 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2007-03-02-VaCopy: 400.00% (0.0040 => 0.0200, std.dev.: 0.0033)
  SingleSource/Regression/C/matrixTranspose: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027)
  SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0039)
  SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045)
  MultiSource/Benchmarks/FreeBench/mason/mason: 18.75% (0.0640 => 0.0760, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/fbench: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/em3d/em3d: 17.39% (0.1840 => 0.2160, std.dev.: 0.0078)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0032)
  SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.54% (0.1040 => 0.1160, std.dev.: 0.0035)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.11% (0.2880 => 0.3200, std.dev.: 0.0107)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.69% (0.1560 => 0.1680, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2200 => 0.2360, std.dev.: 0.0054)
  MultiSource/Applications/obsequi/Obsequi: 3.85% (1.2480 => 1.2960, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.12% (1.1521 => 1.1881, std.dev.: 0.0078)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.78% (1.7280 => 1.7760, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.80% (1.3361 => 1.3601, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.79% (1.1201 => 1.1401, std.dev.: 0.0062)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.56% (4.8840 => 4.9600, std.dev.: 0.0238)
  MultiSource/Applications/lemon/lemon: 1.46% (1.3681 => 1.3881, std.dev.: 0.0059)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.35% (15.0602 => 15.2642, std.dev.: 0.0551)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 28.57% (0.0560 => 0.0720, std.dev.: 0.0047)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0121)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (0.2440 => 0.2560, std.dev.: 0.0020)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.85% (0.7280 => 0.7560, std.dev.: 0.0095)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0041)
  SingleSource/UnitTests/2002-08-02-CastTest2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026)
  SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036)
  SingleSource/UnitTests/2003-07-08-BitOpsTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045)
  SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039)
  SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0055)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0126)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2440 => 0.2560, std.dev.: 0.0039)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.37% (1.1880 => 1.2280, std.dev.: 0.0116)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.30% (1.7360 => 1.7760, std.dev.: 0.0140)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.01% (8.1441 => 8.3081, std.dev.: 0.0416)
  MultiSource/Applications/sqlite3/sqlite3: 1.84% (23.7574 => 24.1935, std.dev.: 0.0590)
  MultiSource/Applications/JM/lencod/lencod: 1.09% (17.6165 => 17.8085, std.dev.: 0.0645)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0024)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0121)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0032)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.19% (1.3481 => 1.3641, std.dev.: 0.0051)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.52% (2.3881 => 2.2801, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0041)
  MultiSource/Applications/sqlite3/sqlite3: -1.28% (4.0643 => 4.0122, std.dev.: 0.0133)

Report Time: 1.90s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140124/859fabbe/attachment.html>