[llvm-testresults] pollyperf4__pollyperf-O3__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Jan 5 22:48:16 PST 2014


http://llvm.org/perf/db_default/v4/nts/19809?compare_to=19788&baseline=18565
Nickname: pollyperf4__pollyperf-O3__clang_DEV__x86_64:24

Comparing:
     Run: 19809, Order: 198581, Start Time: 2014-01-06 02:11:11, End Time: 2014-01-06 06:52:55
      To: 19788, Order: 198567, Start Time: 2014-01-05 21:10:52, End Time: 2014-01-06 01:53:30
Baseline: 18565, Order: 197552, Start Time: 2013-12-18 08:27:56, End Time: 2013-12-18 13:39:39

===============
Tests Summary
===============

Performance Regressions: 8 (42 on baseline)
Performance Improvements: 1 (8 on baseline)
Unchanged Tests: 1101 (1060 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2004-02-02-NegativeZero: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028)
  SingleSource/Benchmarks/Stanford/Treesort: 50.00% (0.0320 => 0.0480, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 18.75% (0.0640 => 0.0760, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.03% (1.1801 => 1.2041, std.dev.: 0.0059)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.6201 => 1.6481, std.dev.: 0.0092)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 2.21% (1.0841 => 1.1081, std.dev.: 0.0082)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C++/EH/throw_rethrow_test: -37.50% (0.0320 => 0.0200, std.dev.: 0.0043)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/fib2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041)
  SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037)
  SingleSource/Benchmarks/Stanford/Bubblesort: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045)
  MultiSource/Benchmarks/FreeBench/mason/mason: 18.75% (0.0640 => 0.0760, std.dev.: 0.0028)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 11.54% (0.1040 => 0.1160, std.dev.: 0.0032)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.77% (0.2600 => 0.2880, std.dev.: 0.0084)
  MultiSource/Benchmarks/Olden/bh/bh: 8.97% (0.3120 => 0.3400, std.dev.: 0.0093)
  SingleSource/Benchmarks/Shootout-C++/ary: 7.25% (0.2760 => 0.2960, std.dev.: 0.0065)
  MultiSource/Benchmarks/McCat/18-imp/imp: 6.00% (0.4000 => 0.4240, std.dev.: 0.0067)
  SingleSource/UnitTests/Vector/constpool: 4.69% (10.3966 => 10.8847, std.dev.: 0.1715)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.91% (0.5120 => 0.5320, std.dev.: 0.0065)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 2.75% (0.4360 => 0.4480, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.65% (1.2081 => 1.2401, std.dev.: 0.0105)
  MultiSource/Benchmarks/nbench/nbench: 2.58% (1.2400 => 1.2720, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.38% (1.1761 => 1.2041, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.30% (1.2161 => 1.2441, std.dev.: 0.0088)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.30% (2.7802 => 2.8442, std.dev.: 0.0088)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.14% (5.7840 => 5.9080, std.dev.: 0.0267)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.06% (4.8440 => 4.9440, std.dev.: 0.0224)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.01% (1.1921 => 1.2161, std.dev.: 0.0067)
  MultiSource/Applications/sqlite3/sqlite3: 1.81% (23.3854 => 23.8094, std.dev.: 0.0540)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.77% (1.1281 => 1.1481, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.73% (1.1561 => 1.1761, std.dev.: 0.0059)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.6201 => 1.6481, std.dev.: 0.0092)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.61% (27.7977 => 28.2458, std.dev.: 0.0775)
  MultiSource/Applications/ClamAV/clamscan: 1.59% (17.3242 => 17.6002, std.dev.: 0.0409)
  MultiSource/Applications/siod/siod: 1.58% (2.5361 => 2.5761, std.dev.: 0.0153)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.56% (2.5722 => 2.6122, std.dev.: 0.0096)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.38% (15.0802 => 15.2882, std.dev.: 0.0463)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.27% (1.2561 => 1.2721, std.dev.: 0.0061)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.24% (10.3562 => 10.4842, std.dev.: 0.0377)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.14% (47.9448 => 48.4928, std.dev.: 0.0947)
  MultiSource/Applications/kimwitu++/kc: 1.11% (18.6850 => 18.8930, std.dev.: 0.0588)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.11% (3.9682 => 4.0122, std.dev.: 0.0142)
  MultiSource/Applications/JM/lencod/lencod: 1.07% (17.5685 => 17.7565, std.dev.: 0.0671)
  MultiSource/Applications/SPASS/SPASS: 1.03% (17.4444 => 17.6244, std.dev.: 0.0460)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.00% (0.1000 => 0.1120, std.dev.: 0.0018)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.48% (1.1761 => 1.2641, std.dev.: 0.0132)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.52% (0.1840 => 0.1960, std.dev.: 0.0018)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0057)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 2.21% (1.0841 => 1.1081, std.dev.: 0.0082)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -63.38% (90.4297 => 33.1181, std.dev.: 21.2454)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -63.07% (46.3269 => 17.1091, std.dev.: 10.4917)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -60.84% (125.5798 => 49.1711, std.dev.: 27.1869)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.00% (0.0400 => 0.0240, std.dev.: 0.0058)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -26.53% (3.2122 => 2.3601, std.dev.: 0.1073)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -24.36% (37.8384 => 28.6218, std.dev.: 0.7088)
  SingleSource/Benchmarks/McGill/chomp: -13.80% (1.0721 => 0.9241, std.dev.: 0.0090)
  MultiSource/Applications/aha/aha: -1.03% (2.7082 => 2.6802, std.dev.: 0.0020)

Report Time: 2.15s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140106/b25375c5/attachment.html>


More information about the llvm-testresults mailing list