[llvm-testresults] pollyperf2pollyperf-O3clang_DEV__x86_64 test results

Sat Dec 14 10:48:25 PST 2013

http://llvm.org/perf/db_default/v4/nts/18422?compare_to=18418&baseline=17631
Nickname: pollyperf2__pollyperf-O3__clang_DEV__x86_64:20

Comparing:
     Run: 18422, Order: 197326, Start Time: 2013-12-14 17:30:51, End Time: 2013-12-14 18:52:43
      To: 18418, Order: 197324, Start Time: 2013-12-14 14:30:20, End Time: 2013-12-14 15:52:21
Baseline: 17631, Order: 195829, Start Time: 2013-11-27 09:28:54, End Time: 2013-11-27 10:53:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 46 (65 on baseline)
Performance Improvements: 9 (8 on baseline)
Unchanged Tests: 1055 (1036 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/ms_struct-bitfield-init-1: 133.33% (0.0120 => 0.0280, std.dev.: 0.0019)
  SingleSource/UnitTests/FloatPrecision: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
  SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
  SingleSource/Regression/C++/2011-03-28-Bitfield: 75.00% (0.0160 => 0.0280, std.dev.: 0.0019)
  SingleSource/UnitTests/ms_struct_pack_layout: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 60.00% (0.0200 => 0.0320)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 60.00% (0.0200 => 0.0320, std.dev.: 0.0019)
  SingleSource/Regression/C/compare: 60.00% (0.0200 => 0.0320, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/flops-4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/flops-8: 42.86% (0.0280 => 0.0400, std.dev.: 0.0019)
  SingleSource/Benchmarks/Stanford/Queens: 40.00% (0.0400 => 0.0560, std.dev.: 0.0019)
  SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 27.27% (0.0440 => 0.0560, std.dev.: 0.0019)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033)
  SingleSource/Benchmarks/Dhrystone/dry: 25.00% (0.0480 => 0.0600, std.dev.: 0.0038)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 21.43% (0.0560 => 0.0680)
  SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0038)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.23% (0.1040 => 0.1240, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0019)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0033)
  MultiSource/Benchmarks/FreeBench/neural/neural: 11.36% (0.1760 => 0.1960, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.11% (0.1080 => 0.1200, std.dev.: 0.0019)
  MultiSource/Benchmarks/FreeBench/distray/distray: 10.34% (0.1160 => 0.1280, std.dev.: 0.0038)
  SingleSource/Benchmarks/SmallPT/smallpt: 8.57% (0.1400 => 0.1520, std.dev.: 0.0019)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 7.14% (0.1680 => 0.1800, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0050)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.11% (0.2920 => 0.3040)
  MultiSource/Applications/sgefa/sgefa: 3.85% (0.4160 => 0.4320, std.dev.: 0.0033)
  MultiSource/Applications/obsequi/Obsequi: 3.57% (1.2320 => 1.2760, std.dev.: 0.0118)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.79% (0.7160 => 0.7360, std.dev.: 0.0019)
  MultiSource/Applications/Burg/burg: 2.17% (1.4720 => 1.5040, std.dev.: 0.0105)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 1.98% (1.2120 => 1.2360, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.95% (1.2321 => 1.2561, std.dev.: 0.0050)
  MultiSource/Applications/hbd/hbd: 1.68% (1.6680 => 1.6960, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.40% (1.1441 => 1.1601, std.dev.: 0.0057)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/kimwitu++/kc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/strcat: 31.25% (0.0640 => 0.0840, std.dev.: 0.0019)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.30% (0.7440 => 0.7760, std.dev.: 0.0068)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.67% (0.7480 => 0.7680, std.dev.: 0.0057)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 2.33% (3.9522 => 4.0443, std.dev.: 0.0247)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.03% (0.9841 => 1.0041, std.dev.: 0.0019)
  MultiSource/Benchmarks/Olden/bisort/bisort: 1.62% (0.7400 => 0.7520, std.dev.: 0.0000)
  MultiSource/Applications/obsequi/Obsequi: 1.52% (2.1041 => 2.1361, std.dev.: 0.0065)
  SingleSource/Benchmarks/Misc/fbench: 1.23% (1.9561 => 1.9801, std.dev.: 0.0086)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/block-byref-test: -100.00% (0.0160 => 0.0000, std.dev.: 0.0019)
  SingleSource/UnitTests/conditional-gnu-ext-cxx: -60.00% (0.0200 => 0.0080, std.dev.: 0.0038)
  SingleSource/UnitTests/2007-01-04-KNR-Args: -50.00% (0.0240 => 0.0120, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.70% (0.3240 => 0.3120, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.63% (0.4560 => 0.4440, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.29% (1.2201 => 1.1921, std.dev.: 0.0098)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.21% (1.6481 => 1.6281, std.dev.: 0.0065)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -14.29% (0.2240 => 0.1920, std.dev.: 0.0115)
  MultiSource/Benchmarks/nbench/nbench: -7.93% (18.7052 => 17.2211, std.dev.: 0.4953)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.88% (0.2720 => 0.2880, std.dev.: 0.0075)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/short_circuit_dtor: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038)
  SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
  SingleSource/Regression/C++/2011-03-28-Bitfield: 75.00% (0.0160 => 0.0280, std.dev.: 0.0019)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: 75.00% (0.0160 => 0.0280)
  SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0019)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0033)
  SingleSource/UnitTests/SignlessTypes/ccc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038)
  SingleSource/Benchmarks/Stanford/Queens: 40.00% (0.0400 => 0.0560, std.dev.: 0.0019)
  MultiSource/Applications/sqlite3/sqlite3: 37.54% (17.1050 => 23.5254, std.dev.: 0.0086)
  SingleSource/Benchmarks/Shootout/random: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038)
  SingleSource/UnitTests/SignlessTypes/factor: 33.33% (0.0360 => 0.0480, std.dev.: 0.0000)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 33.33% (0.0600 => 0.0800, std.dev.: 0.0050)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.00% (0.1000 => 0.1240, std.dev.: 0.0019)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.00% (0.1000 => 0.1200, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.39% (0.0920 => 0.1080, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.02% (0.3760 => 0.4400, std.dev.: 0.0082)
  SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.50% (0.0960 => 0.1080, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 12.50% (0.0960 => 0.1080, std.dev.: 0.0019)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.15% (25.1416 => 27.9457, std.dev.: 0.0392)
  MultiSource/Applications/lemon/lemon: 10.93% (1.2441 => 1.3801, std.dev.: 0.0094)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.69% (5.3640 => 5.8840, std.dev.: 0.0409)
  SingleSource/Benchmarks/Misc/oourafft: 9.23% (0.2600 => 0.2840, std.dev.: 0.0019)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 8.82% (0.1360 => 0.1480, std.dev.: 0.0019)
  SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.57% (0.2800 => 0.3040)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.59% (0.3160 => 0.3400, std.dev.: 0.0068)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.85% (0.2920 => 0.3120, std.dev.: 0.0019)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.70% (5.4960 => 5.8640, std.dev.: 0.0548)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.54% (1.3720 => 1.4480, std.dev.: 0.0173)
  MultiSource/Applications/oggenc/oggenc: 5.01% (5.5123 => 5.7884, std.dev.: 0.0151)
  SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/methcall: 4.92% (0.2440 => 0.2560, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0075)
  SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0019)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.79% (1.3720 => 1.4240, std.dev.: 0.0180)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.77% (1.4840 => 1.5400, std.dev.: 0.0212)
  MultiSource/Applications/obsequi/Obsequi: 3.24% (1.2360 => 1.2760, std.dev.: 0.0118)
  MultiSource/Applications/hexxagon/hexxagon: 3.17% (1.1360 => 1.1720, std.dev.: 0.0100)
  MultiSource/Applications/hbd/hbd: 2.91% (1.6480 => 1.6960, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.79% (0.7160 => 0.7360, std.dev.: 0.0019)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.32% (1.2080 => 1.2360, std.dev.: 0.0050)
  MultiSource/Applications/siod/siod: 1.90% (2.5321 => 2.5801, std.dev.: 0.0098)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.89% (2.5402 => 2.5882, std.dev.: 0.0086)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.86% (6.0320 => 6.1440, std.dev.: 0.0173)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.75% (1.6001 => 1.6281, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.64% (1.2201 => 1.2401, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.63% (1.2281 => 1.2481, std.dev.: 0.0068)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.57% (47.3607 => 48.1049, std.dev.: 0.0692)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.42% (10.6760 => 10.8280, std.dev.: 0.0358)
  MultiSource/Applications/SPASS/SPASS: 1.37% (17.2884 => 17.5244, std.dev.: 0.0526)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.29% (1.2441 => 1.2601, std.dev.: 0.0057)
  MultiSource/Applications/JM/ldecod/ldecod: 1.13% (7.7962 => 7.8842, std.dev.: 0.0245)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/strcat: 50.00% (0.0560 => 0.0840, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/moments: 12.50% (0.0960 => 0.1080, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.39% (0.3160 => 0.3520, std.dev.: 0.0086)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 5.12% (1.3281 => 1.3961, std.dev.: 0.0200)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.35% (0.7360 => 0.7680, std.dev.: 0.0057)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.74% (0.7480 => 0.7760, std.dev.: 0.0068)
  MultiSource/Applications/obsequi/Obsequi: 3.09% (2.0721 => 2.1361, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.98% (4.0363 => 4.1163, std.dev.: 0.0019)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.63% (0.7360 => 0.7480, std.dev.: 0.0019)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.32% (2.4282 => 2.4602, std.dev.: 0.0124)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.13% (2.4722 => 2.5002, std.dev.: 0.0105)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: -60.00% (0.0200 => 0.0080, std.dev.: 0.0033)
  SingleSource/UnitTests/conditional-gnu-ext-cxx: -60.00% (0.0200 => 0.0080, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/fp-convert: -40.00% (0.0400 => 0.0240, std.dev.: 0.0050)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -23.53% (0.0680 => 0.0520, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -19.05% (0.0840 => 0.0680, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.58% (6.0924 => 5.7524, std.dev.: 0.0019)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -5.88% (0.3400 => 0.3200, std.dev.: 0.0050)
  MultiSource/Applications/SPASS/SPASS: -1.67% (9.3406 => 9.1846, std.dev.: 0.0459)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131214/826fe06a/attachment.html>

[llvm-testresults] pollyperf2__pollyperf-O3__clang_DEV__x86_64 test results

[llvm-testresults] pollyperf2pollyperf-O3clang_DEV__x86_64 test results