[llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

Fri Jan 17 03:29:25 PST 2014

http://llvm.org/perf/db_default/v4/nts/20708?compare_to=20685&baseline=19899
Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35

Comparing:
     Run: 20708, Order: 199467, Start Time: 2014-01-17 06:46:49, End Time: 2014-01-17 11:34:17
      To: 20685, Order: 199447, Start Time: 2014-01-17 01:48:03, End Time: 2014-01-17 06:35:28
Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02

===============
Tests Summary
===============

Performance Regressions: 32 (28 on baseline)
Unchanged Tests: 1078 (1082 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2008-01-07-LongDouble: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030)
  SingleSource/UnitTests/2003-07-06-IntOverflow: 133.33% (0.0120 => 0.0280, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 50.00% (0.0400 => 0.0600, std.dev.: 0.0053)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 31.58% (0.0760 => 0.1000, std.dev.: 0.0057)
  SingleSource/UnitTests/Vector/SSE/sse_shift: 27.27% (0.0440 => 0.0560, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.00% (0.1000 => 0.1200, std.dev.: 0.0066)
  SingleSource/Benchmarks/Misc/richards_benchmark: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.38% (0.1040 => 0.1200, std.dev.: 0.0054)
  MultiSource/Applications/viterbi/viterbi: 13.73% (0.2040 => 0.2320, std.dev.: 0.0084)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.11% (0.1440 => 0.1600, std.dev.: 0.0054)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.11% (0.2520 => 0.2800, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 8.47% (0.2360 => 0.2560, std.dev.: 0.0068)
  SingleSource/Benchmarks/Shootout-C++/wc: 8.06% (0.2480 => 0.2680, std.dev.: 0.0062)
  SingleSource/Benchmarks/Misc/ReedSolomon: 6.90% (0.2320 => 0.2480, std.dev.: 0.0032)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 6.67% (0.2400 => 0.2560, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0035)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.56% (0.2880 => 0.3040, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0039)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.95% (1.3160 => 1.3680, std.dev.: 0.0084)
  SingleSource/Benchmarks/Misc/oourafft: 3.95% (0.3040 => 0.3160, std.dev.: 0.0031)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.70% (1.2960 => 1.3440, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.11% (1.1561 => 1.1921, std.dev.: 0.0068)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.86% (0.5600 => 0.5760, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.05% (1.1681 => 1.1921, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.04% (1.1761 => 1.2001, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.61% (1.2441 => 1.2641, std.dev.: 0.0070)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (1.3121 => 1.3401, std.dev.: 0.0065)
  SingleSource/Benchmarks/McGill/chomp: 1.30% (0.9201 => 0.9321, std.dev.: 0.0045)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.14% (2.4642 => 2.4922, std.dev.: 0.0022)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
  SingleSource/Regression/C/testtrace: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036)
  SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045)
  MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.38% (0.1040 => 0.1200, std.dev.: 0.0054)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.11% (0.1800 => 0.2000, std.dev.: 0.0069)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.11% (0.2520 => 0.2800, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3000 => 0.3160, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.29% (0.6800 => 0.7160, std.dev.: 0.0122)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0039)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 3.60% (0.5560 => 0.5760, std.dev.: 0.0054)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0052)
  MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0054)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.17% (9.5802 => 9.8842, std.dev.: 0.0379)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.11% (1.1561 => 1.1921, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.38% (1.1761 => 1.2041, std.dev.: 0.0078)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.09% (1.3400 => 1.3680, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.05% (1.1721 => 1.1961, std.dev.: 0.0082)
  MultiSource/Applications/oggenc/oggenc: 1.15% (6.2844 => 6.3564, std.dev.: 0.0182)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0047)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.42% (3.9842 => 4.2003, std.dev.: 0.0247)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.3201 => 1.3401, std.dev.: 0.0065)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0042)
  MultiSource/Applications/aha/aha: 1.39% (2.8802 => 2.9202, std.dev.: 0.0024)
  MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0563 => 4.1003, std.dev.: 0.0134)

Report Time: 2.42s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140117/15757842/attachment.html>