[llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results

Fri Jan 17 08:23:34 PST 2014

http://llvm.org/perf/db_default/v4/nts/20725?compare_to=20721&baseline=19898
Nickname: pollyperf-O3__clang_DEV__x86_64:34

Comparing:
     Run: 20725, Order: 199489, Start Time: 2014-01-17 11:46:23, End Time: 2014-01-17 16:28:26
      To: 20721, Order: 199485, Start Time: 2014-01-17 10:42:12, End Time: 2014-01-17 15:25:58
Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29

===============
Tests Summary
===============

Performance Regressions: 24 (28 on baseline)
Performance Improvements: 1 (4 on baseline)
Unchanged Tests: 1085 (1078 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/byval-alignment: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041)
  SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041)
  SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042)
  SingleSource/UnitTests/2002-05-02-CastTest: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.00% (0.1600 => 0.1920, std.dev.: 0.0074)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.05% (0.0840 => 0.1000, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.75% (0.1280 => 0.1520, std.dev.: 0.0053)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0038)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0030)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.51% (0.5080 => 0.5360, std.dev.: 0.0071)
  MultiSource/Benchmarks/McCat/05-eks/eks: 5.42% (0.6640 => 0.7000, std.dev.: 0.0065)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.08% (1.3720 => 1.4280, std.dev.: 0.0203)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.89% (4.8760 => 4.9680, std.dev.: 0.0343)
  MultiSource/Applications/JM/lencod/lencod: 1.52% (17.6045 => 17.8725, std.dev.: 0.0397)
  MultiSource/Applications/lua/lua: 1.40% (4.5600 => 4.6240, std.dev.: 0.0218)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.37% (8.1681 => 8.2801, std.dev.: 0.0278)
  MultiSource/Applications/oggenc/oggenc: 1.32% (5.7644 => 5.8404, std.dev.: 0.0076)
  MultiSource/Benchmarks/Bullet/bullet: 1.10% (37.0245 => 37.4325, std.dev.: 0.0814)
  MultiSource/Applications/kimwitu++/kc: 1.09% (18.7410 => 18.9450, std.dev.: 0.0358)
  MultiSource/Applications/ClamAV/clamscan: 1.01% (17.4522 => 17.6282, std.dev.: 0.0516)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/strcat: 16.13% (0.1240 => 0.1440, std.dev.: 0.0076)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (1.3441 => 1.3641, std.dev.: 0.0041)
  MultiSource/Applications/sqlite3/sqlite3: 1.20% (3.9962 => 4.0443, std.dev.: 0.0135)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9282 => 3.8482, std.dev.: 0.0266)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044)
  SingleSource/Regression/C++/fixups: 133.33% (0.0120 => 0.0280, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/flops-7: 66.67% (0.0240 => 0.0400, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040)
  SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0054)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0053)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0045)
  MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0090)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0109)
  MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0066)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.19% (1.1281 => 1.1641, std.dev.: 0.0047)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.94% (0.6800 => 0.7000, std.dev.: 0.0065)
  MultiSource/Benchmarks/nbench/nbench: 2.88% (1.2480 => 1.2840, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.85% (1.1241 => 1.1561, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.69% (1.1881 => 1.2201, std.dev.: 0.0123)
  MultiSource/Applications/lua/lua: 2.30% (4.5200 => 4.6240, std.dev.: 0.0218)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.67% (8.1441 => 8.2801, std.dev.: 0.0278)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.62% (1.2361 => 1.2561, std.dev.: 0.0067)
  MultiSource/Applications/JM/lencod/lencod: 1.45% (17.6165 => 17.8725, std.dev.: 0.0397)
  MultiSource/Applications/ClamAV/clamscan: 1.26% (17.4082 => 17.6282, std.dev.: 0.0516)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0032)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0097)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0045)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.04% (4.5043 => 4.5963, std.dev.: 0.0356)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.19% (1.3481 => 1.3641, std.dev.: 0.0041)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.35% (2.3881 => 2.2841, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0266)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030)

Report Time: 2.40s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140117/91cb7992/attachment.html>