[llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jan 7 13:24:18 PST 2014


http://llvm.org/perf/db_default/v4/nts/19958?compare_to=19937&baseline=19899
Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35

Comparing:
     Run: 19958, Order: 198692, Start Time: 2014-01-07 16:37:52, End Time: 2014-01-07 21:28:59
      To: 19937, Order: 198684, Start Time: 2014-01-07 11:26:29, End Time: 2014-01-07 16:20:27
Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02

===============
Tests Summary
===============

Performance Regressions: 18 (26 on baseline)
Unchanged Tests: 1092 (1084 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-02-ManyArguments: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045)
  SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035)
  SingleSource/UnitTests/2003-05-12-MinIntProblem: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042)
  SingleSource/Regression/C/compare: 100.00% (0.0160 => 0.0320, std.dev.: 0.0033)
  SingleSource/Regression/C/badidx: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.09% (0.0920 => 0.1160, std.dev.: 0.0087)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 20.00% (0.0800 => 0.0960, std.dev.: 0.0026)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 17.86% (0.1120 => 0.1320, std.dev.: 0.0047)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: 17.39% (0.0920 => 0.1080, std.dev.: 0.0040)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.47% (0.2360 => 0.2560, std.dev.: 0.0051)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.17% (0.7360 => 0.7520, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.70% (1.1761 => 1.1961, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.23% (1.3041 => 1.3201, std.dev.: 0.0042)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.34% (5.0683 => 5.1363, std.dev.: 0.0112)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044)
  SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042)
  SingleSource/Regression/C++/pointer_method2: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027)
  SingleSource/Regression/C/compare: 60.00% (0.0200 => 0.0320, std.dev.: 0.0033)
  MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0031)
  MultiSource/Benchmarks/Olden/power/power: 15.79% (0.1520 => 0.1760, std.dev.: 0.0078)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.33% (0.1440 => 0.1560, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0059)
  SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0070)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.71% (0.6800 => 0.7120, std.dev.: 0.0124)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 4.39% (0.4560 => 0.4760, std.dev.: 0.0072)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.91% (1.1240 => 1.1680, std.dev.: 0.0148)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.79% (1.4760 => 1.5320, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.07% (1.1721 => 1.2081, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.38% (1.1761 => 1.2041, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.17% (1.2921 => 1.3201, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.05% (1.1721 => 1.1961, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.05% (1.3681 => 1.3961, std.dev.: 0.0084)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.72% (2.0920 => 2.1280, std.dev.: 0.0114)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.34% (5.3840 => 5.4560, std.dev.: 0.0251)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 8.70% (0.1840 => 0.2000, std.dev.: 0.0059)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0037)

Report Time: 0.94s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140107/eaf45d7e/attachment.html>


More information about the llvm-testresults mailing list