[llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jan 10 16:23:39 PST 2014


http://llvm.org/perf/db_default/v4/nts/20244?compare_to=20238&baseline=19898
Nickname: pollyperf-O3__clang_DEV__x86_64:34

Comparing:
     Run: 20244, Order: 198952, Start Time: 2014-01-10 19:44:53, End Time: 2014-01-11 00:28:25
      To: 20238, Order: 198950, Start Time: 2014-01-10 18:57:00, End Time: 2014-01-10 23:40:21
Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29

===============
Tests Summary
===============

Performance Regressions: 19 (27 on baseline)
Performance Improvements: 1 (1 on baseline)
Unchanged Tests: 1090 (1082 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045)
  SingleSource/UnitTests/SignlessTypes/cast2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027)
  SingleSource/UnitTests/TestLoop: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/flops-5: 80.00% (0.0200 => 0.0360, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout/ackermann: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040)
  SingleSource/Regression/C/DuffsDevice: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040)
  SingleSource/Benchmarks/Stanford/IntMM: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.86% (0.1400 => 0.1720, std.dev.: 0.0097)
  MultiSource/Applications/aha/aha: 10.34% (0.1160 => 0.1280, std.dev.: 0.0045)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.51% (0.1880 => 0.2040, std.dev.: 0.0044)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0085)
  SingleSource/Benchmarks/Shootout-C++/methcall: 5.17% (0.2320 => 0.2440, std.dev.: 0.0044)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.11% (1.3640 => 1.4200, std.dev.: 0.0191)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.36% (1.1921 => 1.2321, std.dev.: 0.0060)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.21% (5.7960 => 5.9240, std.dev.: 0.0275)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.54% (4.9200 => 4.9960, std.dev.: 0.0264)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (0.1840 => 0.1960, std.dev.: 0.0041)
  MultiSource/Applications/spiff/spiff: 4.76% (2.0161 => 2.1121, std.dev.: 0.0324)
  MultiSource/Applications/lemon/lemon: 2.81% (0.9961 => 1.0241, std.dev.: 0.0090)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.63% (3.9202 => 3.8562, std.dev.: 0.0238)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051)
  SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 17.50% (0.1600 => 0.1880, std.dev.: 0.0082)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0053)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0085)
  SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout-C++/methcall: 5.17% (0.2320 => 0.2440, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0061)
  MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.69% (1.1881 => 1.2201, std.dev.: 0.0115)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0075)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.33% (6.0160 => 6.1560, std.dev.: 0.0303)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.14% (5.8000 => 5.9240, std.dev.: 0.0275)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.13% (1.1281 => 1.1521, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.07% (1.1601 => 1.1841, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.94% (1.2361 => 1.2601, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.69% (1.1841 => 1.2041, std.dev.: 0.0068)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.67% (8.1441 => 8.2801, std.dev.: 0.0403)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.65% (1.2121 => 1.2321, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (1.2721 => 1.2921, std.dev.: 0.0076)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.54% (4.9200 => 4.9960, std.dev.: 0.0264)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.50% (10.6960 => 10.8560, std.dev.: 0.0524)
  MultiSource/Applications/ClamAV/clamscan: 1.06% (17.4082 => 17.5922, std.dev.: 0.0508)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0049)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0078)
  MultiSource/Applications/lemon/lemon: 3.64% (0.9881 => 1.0241, std.dev.: 0.0090)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.63% (3.9202 => 3.8562, std.dev.: 0.0238)

Report Time: 1.79s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140110/42952dc7/attachment.html>


More information about the llvm-testresults mailing list