[llvm-testresults] pollyperf2__pollyperf-O3__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Fri Dec 13 11:26:50 PST 2013
http://llvm.org/perf/db_default/v4/nts/18381?compare_to=18377&baseline=17631
Nickname: pollyperf2__pollyperf-O3__clang_DEV__x86_64:20
Comparing:
Run: 18381, Order: 197246, Start Time: 2013-12-13 18:09:16, End Time: 2013-12-13 19:31:05
To: 18377, Order: 197239, Start Time: 2013-12-13 16:30:10, End Time: 2013-12-13 17:52:02
Baseline: 17631, Order: 195829, Start Time: 2013-11-27 09:28:54, End Time: 2013-11-27 10:53:00
===============
Tests Summary
===============
New Passes: 0 (1 on baseline)
Performance Regressions: 45 (61 on baseline)
Performance Improvements: 14 (19 on baseline)
Unchanged Tests: 1051 (1029 on baseline)
Total Tests: 1110
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C/2003-05-23-TransparentUnion: 200.00% (0.0080 => 0.0240, std.dev.: 0.0033)
SingleSource/UnitTests/2002-10-09-ArrayResolution: 150.00% (0.0080 => 0.0200, std.dev.: 0.0019)
SingleSource/Regression/C++/2011-03-28-Bitfield: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038)
SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/UnitTests/AtomicOps: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038)
SingleSource/Regression/C/PR10189: 75.00% (0.0160 => 0.0280, std.dev.: 0.0019)
SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0019)
SingleSource/UnitTests/ms_struct-bitfield-init: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033)
SingleSource/Regression/C/matrixTranspose: 60.00% (0.0200 => 0.0320, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360)
SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 40.00% (0.0600 => 0.0840, std.dev.: 0.0019)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038)
SingleSource/Benchmarks/Dhrystone/dry: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.00% (0.1120 => 0.1400, std.dev.: 0.0019)
SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0000)
SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.00% (0.0800 => 0.0920, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.76% (0.1360 => 0.1520, std.dev.: 0.0019)
MultiSource/Benchmarks/SciMark2-C/scimark2: 9.47% (0.3800 => 0.4160, std.dev.: 0.0086)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.43% (0.2120 => 0.2320, std.dev.: 0.0065)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.77% (0.2280 => 0.2480, std.dev.: 0.0068)
SingleSource/Benchmarks/Shootout-C++/EH/except: 8.47% (0.2360 => 0.2560, std.dev.: 0.0038)
MultiSource/Benchmarks/McCat/09-vor/vor: 7.61% (0.3680 => 0.3960, std.dev.: 0.0082)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2200 => 0.2360, std.dev.: 0.0038)
MultiSource/Benchmarks/Olden/bh/bh: 7.06% (0.3400 => 0.3640, std.dev.: 0.0019)
SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560)
SingleSource/Benchmarks/CoyoteBench/fftbench: 6.54% (0.4280 => 0.4560, std.dev.: 0.0019)
MultiSource/Benchmarks/FreeBench/neural/neural: 6.38% (0.1880 => 0.2000, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.35% (0.4600 => 0.4800, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout-C++/hash: 3.64% (0.4400 => 0.4560, std.dev.: 0.0033)
MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.4320 => 1.4760, std.dev.: 0.0057)
MultiSource/Benchmarks/McCat/05-eks/eks: 2.96% (0.6760 => 0.6960, std.dev.: 0.0068)
SingleSource/UnitTests/Vectorizer/gcc-loops: 2.24% (0.5360 => 0.5480, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.57% (1.2721 => 1.2921, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.29% (1.2361 => 1.2521, std.dev.: 0.0038)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.25% (6.0800 => 6.1560, std.dev.: 0.0100)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.29% (0.0840 => 0.0960, std.dev.: 0.0000)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 12.24% (0.1960 => 0.2200, std.dev.: 0.0019)
MultiSource/Benchmarks/llubenchmark/llu: 4.19% (5.2563 => 5.4763, std.dev.: 0.0226)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.24% (0.7400 => 0.7640, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.61% (4.4843 => 4.5563, std.dev.: 0.0254)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.4081 => 1.4241, std.dev.: 0.0033)
SingleSource/Benchmarks/CoyoteBench/fftbench: 1.02% (2.3561 => 2.3801, std.dev.: 0.0033)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Misc/pi: -50.00% (0.0320 => 0.0160, std.dev.: 0.0038)
SingleSource/Regression/C/PR1386: -50.00% (0.0240 => 0.0120, std.dev.: 0.0033)
SingleSource/UnitTests/ms_struct_pack_layout: -42.86% (0.0280 => 0.0160)
SingleSource/Benchmarks/Shootout/ary3: -27.27% (0.0440 => 0.0320, std.dev.: 0.0038)
SingleSource/UnitTests/Vector/SSE/sse_stepfft: -9.37% (0.1280 => 0.1160, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/hello: -7.02% (0.2280 => 0.2120, std.dev.: 0.0057)
SingleSource/Benchmarks/Shootout-C++/random: -6.25% (0.2560 => 0.2400, std.dev.: 0.0019)
MultiSource/Applications/minisat/minisat: -2.43% (0.8240 => 0.8040, std.dev.: 0.0068)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.23% (1.4360 => 1.4040, std.dev.: 0.0065)
MultiSource/Applications/JM/ldecod/ldecod: -1.42% (7.8682 => 7.7562, std.dev.: 0.0408)
MultiSource/Benchmarks/Prolangs-C++/city/city: -1.15% (1.7440 => 1.7240, std.dev.: 0.0068)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -50.00% (0.0320 => 0.0160, std.dev.: 0.0033)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -10.53% (0.3040 => 0.2720, std.dev.: 0.0118)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.48% (0.4840 => 0.4720, std.dev.: 0.0038)
================================
Run-Over-Baseline Changes Detail
================================
New Passes - Execution Time
---------------------------
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Olden/voronoi/voronoi: - (0.2720 => 0.2720, std.dev.: 0.0118)
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C/pointer_arithmetic: 300.00% (0.0040 => 0.0160, std.dev.: 0.0019)
SingleSource/UnitTests/Vector/sumarray: 133.33% (0.0120 => 0.0280, std.dev.: 0.0019)
SingleSource/UnitTests/ms_struct-bitfield-init: 133.33% (0.0120 => 0.0280, std.dev.: 0.0033)
SingleSource/Regression/C/2003-05-23-TransparentUnion: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/UnitTests/2007-03-02-VaCopy: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
SingleSource/UnitTests/2003-05-14-AtExit: 60.00% (0.0200 => 0.0320)
SingleSource/UnitTests/2003-07-09-LoadShorts: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 40.00% (0.0600 => 0.0840, std.dev.: 0.0019)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0038)
SingleSource/Benchmarks/Stanford/Queens: 40.00% (0.0400 => 0.0560, std.dev.: 0.0019)
MultiSource/Applications/sqlite3/sqlite3: 36.67% (17.1050 => 23.3774, std.dev.: 0.0232)
SingleSource/Benchmarks/Misc/salsa20: 36.36% (0.0440 => 0.0600, std.dev.: 0.0019)
MultiSource/Benchmarks/BitBench/five11/five11: 28.57% (0.0560 => 0.0720, std.dev.: 0.0033)
MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 20.00% (0.0800 => 0.0960, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.15% (0.3760 => 0.4480, std.dev.: 0.0082)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.86% (0.1120 => 0.1320, std.dev.: 0.0038)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.67% (0.1200 => 0.1400, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/strcat: 16.36% (0.2200 => 0.2560)
SingleSource/Benchmarks/CoyoteBench/lpbench: 13.16% (0.1520 => 0.1720, std.dev.: 0.0050)
MultiSource/Applications/lemon/lemon: 11.57% (1.2441 => 1.3881, std.dev.: 0.0050)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.03% (25.1416 => 27.9137, std.dev.: 0.0340)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.92% (5.3640 => 5.8960, std.dev.: 0.0105)
MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.59% (0.2920 => 0.3200, std.dev.: 0.0050)
MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.20% (0.3480 => 0.3800, std.dev.: 0.0050)
MultiSource/Benchmarks/Ptrdist/bc/bc: 7.58% (1.3720 => 1.4760, std.dev.: 0.0057)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2200 => 0.2360, std.dev.: 0.0038)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.21% (5.4960 => 5.8920, std.dev.: 0.0210)
SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0033)
MultiSource/Benchmarks/Olden/bh/bh: 5.81% (0.3440 => 0.3640, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.39% (1.4840 => 1.5640, std.dev.: 0.0118)
MultiSource/Applications/oggenc/oggenc: 3.85% (5.5123 => 5.7244, std.dev.: 0.0115)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.77% (0.6360 => 0.6600, std.dev.: 0.0038)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.45% (0.4640 => 0.4800, std.dev.: 0.0033)
MultiSource/Benchmarks/nbench/nbench: 2.88% (1.2520 => 1.2880, std.dev.: 0.0068)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.82% (0.7080 => 0.7280, std.dev.: 0.0050)
MultiSource/Applications/minisat/minisat: 2.55% (0.7840 => 0.8040, std.dev.: 0.0068)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.33% (1.2001 => 1.2281, std.dev.: 0.0075)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.33% (1.3720 => 1.4040, std.dev.: 0.0065)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.08% (1.3441 => 1.3721, std.dev.: 0.0050)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.06% (6.0320 => 6.1560, std.dev.: 0.0100)
MultiSource/Applications/SIBsim4/SIBsim4: 2.00% (1.6001 => 1.6321, std.dev.: 0.0068)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.89% (1.2681 => 1.2921, std.dev.: 0.0019)
MultiSource/Benchmarks/7zip/7zip-benchmark: 1.43% (47.3607 => 48.0369, std.dev.: 0.0413)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.36% (1.1801 => 1.1961, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.28% (1.2521 => 1.2681, std.dev.: 0.0019)
MultiSource/Applications/SPASS/SPASS: 1.27% (17.2884 => 17.5084, std.dev.: 0.0426)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout-C++/ary2: 25.00% (0.0480 => 0.0600, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 10.00% (0.2000 => 0.2200, std.dev.: 0.0019)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.86% (0.3160 => 0.3440, std.dev.: 0.0082)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.17% (0.4640 => 0.4880, std.dev.: 0.0033)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.80% (0.7360 => 0.7640, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.3840 => 0.3960, std.dev.: 0.0019)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.01% (1.3961 => 1.4241, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.88% (4.0363 => 4.1123, std.dev.: 0.0038)
MultiSource/Applications/obsequi/Obsequi: 1.74% (2.0721 => 2.1081, std.dev.: 0.0118)
MultiSource/Benchmarks/llubenchmark/llu: 1.63% (5.3883 => 5.4763, std.dev.: 0.0226)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.63% (0.7360 => 0.7480, std.dev.: 0.0033)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.32% (2.4282 => 2.4602, std.dev.: 0.0019)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/2002-05-03-NotTest: -57.14% (0.0280 => 0.0120, std.dev.: 0.0057)
SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -50.00% (0.0320 => 0.0160, std.dev.: 0.0038)
SingleSource/Benchmarks/Misc/richards_benchmark: -13.04% (0.0920 => 0.0800, std.dev.: 0.0019)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -10.42% (0.1920 => 0.1720, std.dev.: 0.0075)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -9.43% (0.2120 => 0.1920, std.dev.: 0.0065)
MultiSource/Benchmarks/McCat/04-bisect/bisect: -9.30% (0.1720 => 0.1560, std.dev.: 0.0050)
SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.37% (6.0924 => 5.7044, std.dev.: 0.0132)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.30% (1.4560 => 1.4080, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/hash: -2.56% (0.4680 => 0.4560, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout-C++/hash2: -2.38% (0.5040 => 0.4920, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.66% (1.2041 => 1.1841, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.38% (1.1561 => 1.1401, std.dev.: 0.0050)
MultiSource/Benchmarks/Prolangs-C++/city/city: -1.15% (1.7440 => 1.7240, std.dev.: 0.0068)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -27.27% (0.0440 => 0.0320, std.dev.: 0.0033)
MultiSource/Applications/sgefa/sgefa: -2.26% (0.5320 => 0.5200, std.dev.: 0.0038)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: -2.00% (1.2001 => 1.1761)
MultiSource/Applications/SPASS/SPASS: -1.41% (9.3406 => 9.2086, std.dev.: 0.0082)
MultiSource/Applications/minisat/minisat: -1.30% (6.7684 => 6.6804, std.dev.: 0.0199)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -1.29% (2.4722 => 2.4402, std.dev.: 0.0100)
Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131213/d671c7dc/attachment.html>
More information about the llvm-testresults
mailing list