[llvm-testresults] pollyperf2__pollyperf-O3__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Sat Dec 7 06:48:47 PST 2013
http://llvm.org/perf/db_default/v4/nts/18109?compare_to=18106&baseline=17631
Nickname: pollyperf2__pollyperf-O3__clang_DEV__x86_64:20
Comparing:
Run: 18109, Order: 196655, Start Time: 2013-12-07 13:31:20, End Time: 2013-12-07 14:52:54
To: 18106, Order: 196654, Start Time: 2013-12-07 11:52:10, End Time: 2013-12-07 13:13:40
Baseline: 17631, Order: 195829, Start Time: 2013-11-27 09:28:54, End Time: 2013-11-27 10:53:00
===============
Tests Summary
===============
New Passes: 0 (1 on baseline)
Performance Regressions: 31 (45 on baseline)
Performance Improvements: 8 (12 on baseline)
Unchanged Tests: 1071 (1052 on baseline)
Total Tests: 1110
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033)
SingleSource/Benchmarks/BenchmarkGame/recursive: 125.00% (0.0160 => 0.0360, std.dev.: 0.0019)
SingleSource/Regression/C++/2003-05-14-array-init: 100.00% (0.0120 => 0.0240, std.dev.: 0.0000)
SingleSource/UnitTests/2005-05-13-SDivTwo: 75.00% (0.0160 => 0.0280, std.dev.: 0.0019)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 36.36% (0.0880 => 0.1200, std.dev.: 0.0019)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 30.00% (0.0400 => 0.0520)
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 25.00% (0.0640 => 0.0800, std.dev.: 0.0033)
SingleSource/Benchmarks/Dhrystone/fldry: 23.08% (0.0520 => 0.0640, std.dev.: 0.0033)
SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.73% (0.0880 => 0.1080, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout/hash: 21.43% (0.0560 => 0.0680, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.00% (0.0600 => 0.0720, std.dev.: 0.0033)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0019)
SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.57% (0.1400 => 0.1520, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0019)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.10% (0.3280 => 0.3480, std.dev.: 0.0068)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.00% (0.4000 => 0.4200, std.dev.: 0.0050)
MultiSource/Benchmarks/McCat/05-eks/eks: 4.76% (0.6720 => 0.7040, std.dev.: 0.0075)
MultiSource/Benchmarks/McCat/09-vor/vor: 4.26% (0.3760 => 0.3920, std.dev.: 0.0019)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.55% (0.6760 => 0.7000, std.dev.: 0.0057)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.48% (0.4600 => 0.4760, std.dev.: 0.0038)
SingleSource/UnitTests/Vectorizer/gcc-loops: 3.01% (0.5320 => 0.5480, std.dev.: 0.0057)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.31% (1.2121 => 1.2401, std.dev.: 0.0050)
MultiSource/Applications/d/make_dparser: 1.49% (3.7520 => 3.8080, std.dev.: 0.0124)
MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.38% (1.1561 => 1.1721, std.dev.: 0.0019)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.27% (0.9441 => 0.9561, std.dev.: 0.0033)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.19% (5.3680 => 5.4320, std.dev.: 0.0214)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.23% (0.2600 => 0.2840, std.dev.: 0.0075)
SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 8.52% (1.2681 => 1.3761, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 5.99% (1.1361 => 1.2041, std.dev.: 0.0229)
MultiSource/Applications/viterbi/viterbi: 2.53% (2.6882 => 2.7562, std.dev.: 0.0241)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.06% (4.5363 => 4.5843, std.dev.: 0.0161)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C++/pointer_method: -42.86% (0.0280 => 0.0160, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout/sieve: -33.33% (0.0360 => 0.0240, std.dev.: 0.0033)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -14.29% (0.1120 => 0.0960, std.dev.: 0.0050)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.88% (0.2040 => 0.1920, std.dev.: 0.0038)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.19% (0.3080 => 0.2920, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout-C++/ary: -3.95% (0.3040 => 0.2920, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.90% (1.2641 => 1.2401, std.dev.: 0.0075)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.34% (4.1843 => 4.1283, std.dev.: 0.0186)
================================
Run-Over-Baseline Changes Detail
================================
New Passes - Execution Time
---------------------------
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.41% (0.2720 => 0.2840, std.dev.: 0.0075)
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C++/short_circuit_dtor: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038)
SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033)
SingleSource/UnitTests/Vector/sumarray: 133.33% (0.0120 => 0.0280)
SingleSource/Regression/C/2003-05-23-TransparentUnion: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/UnitTests/member-function-pointers: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/Benchmarks/Stanford/Treesort: 50.00% (0.0320 => 0.0480, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 33.33% (0.0600 => 0.0800, std.dev.: 0.0050)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 30.00% (0.0400 => 0.0520, std.dev.: 0.0033)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 30.00% (0.0400 => 0.0520)
SingleSource/Benchmarks/McGill/misr: 29.41% (0.0680 => 0.0880, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc/salsa20: 27.27% (0.0440 => 0.0560, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 19.05% (0.0840 => 0.1000, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.39% (0.0920 => 0.1080, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.39% (0.0920 => 0.1080, std.dev.: 0.0038)
SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.39% (0.0920 => 0.1080, std.dev.: 0.0038)
SingleSource/Benchmarks/Misc/whetstone: 13.04% (0.0920 => 0.1040)
SingleSource/Benchmarks/Shootout-C++/strcat: 9.09% (0.2200 => 0.2400, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.57% (0.1400 => 0.1520, std.dev.: 0.0019)
MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.22% (0.2920 => 0.3160, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2200 => 0.2360, std.dev.: 0.0057)
SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/fibo: 5.66% (0.2120 => 0.2240, std.dev.: 0.0019)
MultiSource/Applications/hbd/hbd: 5.58% (1.6480 => 1.7400, std.dev.: 0.0132)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.69% (0.2560 => 0.2680, std.dev.: 0.0038)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.31% (1.4840 => 1.5480, std.dev.: 0.0131)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.29% (0.2800 => 0.2920, std.dev.: 0.0033)
MultiSource/Benchmarks/McCat/09-vor/vor: 4.26% (0.3760 => 0.3920, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0050)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.79% (1.3720 => 1.4240, std.dev.: 0.0105)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.55% (0.6760 => 0.7000, std.dev.: 0.0057)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.59% (0.4640 => 0.4760, std.dev.: 0.0038)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.79% (6.0320 => 6.1400, std.dev.: 0.0118)
MultiSource/Benchmarks/nbench/nbench: 1.28% (1.2520 => 1.2680, std.dev.: 0.0057)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.27% (0.9441 => 0.9561, std.dev.: 0.0033)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.27% (5.3640 => 5.4320, std.dev.: 0.0214)
MultiSource/Applications/oggenc/oggenc: 1.16% (5.5123 => 5.5763, std.dev.: 0.0124)
MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.03% (1.1601 => 1.1721, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.02% (1.1761 => 1.1881, std.dev.: 0.0038)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/strcat: 17.65% (0.1360 => 0.1600, std.dev.: 0.0033)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.13% (0.3160 => 0.3480, std.dev.: 0.0057)
SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 3.93% (1.3241 => 1.3761, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout-C++/hash: 3.82% (0.5240 => 0.5440, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.42% (3.4642 => 3.5482, std.dev.: 0.0322)
MultiSource/Applications/obsequi/Obsequi: 1.54% (2.0721 => 2.1041, std.dev.: 0.0094)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.32% (2.4282 => 2.4602)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C/2003-06-16-InvalidInitializer: -75.00% (0.0160 => 0.0040, std.dev.: 0.0033)
SingleSource/UnitTests/ms_struct-bitfield-1: -75.00% (0.0160 => 0.0040, std.dev.: 0.0038)
SingleSource/UnitTests/2003-09-18-BitFieldTest: -66.67% (0.0240 => 0.0080, std.dev.: 0.0038)
SingleSource/UnitTests/Vector/divides: -42.86% (0.0280 => 0.0160, std.dev.: 0.0019)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: -23.53% (0.0680 => 0.0520, std.dev.: 0.0057)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -21.74% (0.0920 => 0.0720, std.dev.: 0.0050)
SingleSource/Benchmarks/Misc/flops: -10.34% (0.1160 => 0.1040, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -9.43% (0.2120 => 0.1920, std.dev.: 0.0038)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.95% (1.4560 => 1.3840, std.dev.: 0.0278)
MultiSource/Benchmarks/Prolangs-C++/city/city: -1.61% (1.7440 => 1.7160, std.dev.: 0.0057)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Olden/bisort/bisort: -2.67% (0.7480 => 0.7280, std.dev.: 0.0050)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.64% (4.2403 => 4.1283, std.dev.: 0.0186)
Report Time: 2.65s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131207/90bcd525/attachment.html>
More information about the llvm-testresults
mailing list