[llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jan 21 20:42:23 PST 2014


http://llvm.org/perf/db_default/v4/nts/21020?compare_to=20998&baseline=19899
Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35

Comparing:
     Run: 21020, Order: 199773, Start Time: 2014-01-21 23:59:24, End Time: 2014-01-22 04:47:19
      To: 20998, Order: 199760, Start Time: 2014-01-21 19:05:17, End Time: 2014-01-21 23:53:05
Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02

===============
Tests Summary
===============

Performance Regressions: 24 (27 on baseline)
Performance Improvements: 1 (1 on baseline)
Unchanged Tests: 1085 (1082 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/AtomicOps: 400.00% (0.0040 => 0.0200, std.dev.: 0.0044)
  SingleSource/UnitTests/stmtexpr: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036)
  SingleSource/Regression/C/globalrefs: 200.00% (0.0080 => 0.0240, std.dev.: 0.0052)
  SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045)
  SingleSource/Regression/C/PR640: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031)
  SingleSource/Regression/C/uint64_to_float: 44.44% (0.0360 => 0.0520, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.20% (0.1640 => 0.1840, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 11.54% (0.1040 => 0.1160, std.dev.: 0.0043)
  MultiSource/Benchmarks/McCat/09-vor/vor: 7.29% (0.3840 => 0.4120, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.59% (0.7280 => 0.7760, std.dev.: 0.0143)
  SingleSource/Benchmarks/Shootout-C++/matrix: 6.06% (0.2640 => 0.2800, std.dev.: 0.0047)
  MultiSource/Benchmarks/McCat/18-imp/imp: 5.26% (0.4560 => 0.4800, std.dev.: 0.0084)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.90% (1.4680 => 1.5400, std.dev.: 0.0264)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.31% (5.3600 => 5.4840, std.dev.: 0.0414)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.95% (1.2321 => 1.2561, std.dev.: 0.0090)
  MultiSource/Applications/sqlite3/sqlite3: 1.32% (24.8455 => 25.1735, std.dev.: 0.0594)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/18-imp/imp: 18.75% (0.0640 => 0.0760, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 8.89% (0.1800 => 0.1960, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout-C++/hash: 3.13% (0.5120 => 0.5280, std.dev.: 0.0054)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.03% (2.3761 => 2.4482, std.dev.: 0.0259)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.70% (1.1761 => 1.1961, std.dev.: 0.0061)
  MultiSource/Benchmarks/Olden/bisort/bisort: 1.64% (0.7320 => 0.7440, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/power/power: 1.17% (1.3641 => 1.3801, std.dev.: 0.0045)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -30.00% (0.0400 => 0.0280, std.dev.: 0.0041)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038)
  SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045)
  SingleSource/Regression/C/uint64_to_float: 44.44% (0.0360 => 0.0520, std.dev.: 0.0031)
  SingleSource/Benchmarks/McGill/misr: 31.25% (0.0640 => 0.0840, std.dev.: 0.0032)
  MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1320 => 0.1520, std.dev.: 0.0076)
  SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0039)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 11.54% (0.1040 => 0.1160, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0065)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.88% (0.6800 => 0.7200, std.dev.: 0.0102)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.43% (0.7360 => 0.7760, std.dev.: 0.0143)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.07% (0.4920 => 0.5120, std.dev.: 0.0051)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.13% (9.5802 => 9.8802, std.dev.: 0.0628)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.39% (1.1721 => 1.2001, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.34% (1.3681 => 1.4001, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.10% (1.1441 => 1.1681, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.04% (1.1761 => 1.2001, std.dev.: 0.0072)
  MultiSource/Applications/sqlite3/sqlite3: 1.68% (24.7575 => 25.1735, std.dev.: 0.0594)
  MultiSource/Applications/oggenc/oggenc: 1.65% (6.2844 => 6.3884, std.dev.: 0.0144)
  MultiSource/Applications/JM/ldecod/ldecod: 1.63% (8.5802 => 8.7203, std.dev.: 0.0367)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.40% (5.7280 => 5.8080, std.dev.: 0.0281)
  MultiSource/Applications/JM/lencod/lencod: 1.25% (19.5406 => 19.7846, std.dev.: 0.0450)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.17% (2.7282 => 2.7602, std.dev.: 0.0119)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 42.86% (0.0280 => 0.0400, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.95% (0.1720 => 0.1960, std.dev.: 0.0057)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.93% (3.9842 => 4.2203, std.dev.: 0.0224)
  MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.55% (1.2401 => 1.1961, std.dev.: 0.0061)

Report Time: 2.98s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140121/6cbbec8d/attachment.html>


More information about the llvm-testresults mailing list