[llvm-testresults] pollyperf2__pollyperf-O3__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Fri Dec 6 00:21:37 PST 2013
http://llvm.org/perf/db_default/v4/nts/18046?compare_to=18043&baseline=17631
Nickname: pollyperf2__pollyperf-O3__clang_DEV__x86_64:20
Comparing:
Run: 18046, Order: 196565, Start Time: 2013-12-06 07:04:29, End Time: 2013-12-06 08:25:44
To: 18043, Order: 196561, Start Time: 2013-12-06 03:54:07, End Time: 2013-12-06 05:15:25
Baseline: 17631, Order: 195829, Start Time: 2013-11-27 09:28:54, End Time: 2013-11-27 10:53:00
===============
Tests Summary
===============
New Passes: 0 (1 on baseline)
Performance Regressions: 42 (44 on baseline)
Performance Improvements: 9 (8 on baseline)
Unchanged Tests: 1059 (1057 on baseline)
Total Tests: 1110
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/UnitTests/2003-10-29-ScalarReplBug: 400.00% (0.0040 => 0.0200)
SingleSource/UnitTests/block-byref-cxxobj-test: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033)
SingleSource/Regression/C++/EH/function_try_block: 125.00% (0.0160 => 0.0360, std.dev.: 0.0019)
SingleSource/UnitTests/2007-01-04-KNR-Args: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038)
SingleSource/UnitTests/SignlessTypes/cast2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/UnitTests/printargs: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/Regression/C/badidx: 80.00% (0.0200 => 0.0360, std.dev.: 0.0033)
SingleSource/Regression/C++/pointer_method: 75.00% (0.0160 => 0.0280, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 33.33% (0.0360 => 0.0480, std.dev.: 0.0019)
SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0019)
SingleSource/UnitTests/vla: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 26.32% (0.0760 => 0.0960, std.dev.: 0.0000)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0019)
SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.0840 => 0.0960, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/hello: 11.76% (0.2040 => 0.2280, std.dev.: 0.0038)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.00% (0.1600 => 0.1760, std.dev.: 0.0050)
MultiSource/Benchmarks/FreeBench/neural/neural: 9.09% (0.1760 => 0.1920, std.dev.: 0.0057)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.00% (0.2000 => 0.2160)
MultiSource/Benchmarks/Ptrdist/ks/ks: 6.82% (0.1760 => 0.1880, std.dev.: 0.0000)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.43% (0.6840 => 0.7280, std.dev.: 0.0000)
SingleSource/Benchmarks/Shootout-C++/ary3: 5.56% (0.2880 => 0.3040, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout-C++/fibo: 5.45% (0.2200 => 0.2320, std.dev.: 0.0038)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.06% (0.3160 => 0.3320, std.dev.: 0.0038)
MultiSource/Benchmarks/McCat/05-eks/eks: 4.79% (0.6680 => 0.7000, std.dev.: 0.0050)
MultiSource/Benchmarks/MallocBench/gs/gs: 2.48% (4.8480 => 4.9680, std.dev.: 0.0360)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.39% (1.1721 => 1.2001, std.dev.: 0.0033)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.74% (4.8280 => 4.9120, std.dev.: 0.0180)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.70% (1.1761 => 1.1961, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.58% (1.2641 => 1.2841, std.dev.: 0.0050)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1520 => 1.1680, std.dev.: 0.0050)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.32% (1.2121 => 1.2281, std.dev.: 0.0033)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.31% (0.9161 => 0.9281, std.dev.: 0.0019)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Olden/mst/mst: 10.34% (0.1160 => 0.1280, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 8.36% (1.1961 => 1.2961, std.dev.: 0.0322)
MultiSource/Benchmarks/llubenchmark/llu: 4.20% (5.3363 => 5.5603, std.dev.: 0.0459)
SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.70% (0.3240 => 0.3360)
MultiSource/Benchmarks/Olden/tsp/tsp: 3.38% (1.3001 => 1.3441, std.dev.: 0.0086)
MultiSource/Benchmarks/Fhourstones/fhourstones: 3.27% (1.1001 => 1.1361, std.dev.: 0.0068)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.14% (4.5563 => 4.6083, std.dev.: 0.0189)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Stanford/Oscar: -20.00% (0.0800 => 0.0640, std.dev.: 0.0050)
SingleSource/Benchmarks/Shootout-C++/random: -7.69% (0.2600 => 0.2400, std.dev.: 0.0050)
SingleSource/Benchmarks/Shootout-C++/heapsort: -4.48% (0.2680 => 0.2560, std.dev.: 0.0019)
SingleSource/Benchmarks/Misc/oourafft: -4.41% (0.2720 => 0.2600, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.33% (1.2041 => 1.1761, std.dev.: 0.0105)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -5.83% (0.4120 => 0.3880, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -5.08% (1.1801 => 1.1201, std.dev.: 0.0147)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.79% (29.2538 => 28.7298, std.dev.: 0.1197)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.15% (4.1723 => 4.1243, std.dev.: 0.0151)
================================
Run-Over-Baseline Changes Detail
================================
New Passes - Execution Time
---------------------------
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.47% (0.2720 => 0.2680, std.dev.: 0.0124)
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C++/short_circuit_dtor: 400.00% (0.0040 => 0.0200, std.dev.: 0.0033)
SingleSource/UnitTests/2003-10-13-SwitchTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0019)
SingleSource/Regression/C/2004-03-15-IndirectGoto: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
SingleSource/UnitTests/2007-01-04-KNR-Args: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038)
SingleSource/UnitTests/ms_struct-bitfield-init-1: 60.00% (0.0200 => 0.0320, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 46.67% (0.0600 => 0.0880, std.dev.: 0.0019)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0057)
SingleSource/Benchmarks/Stanford/Queens: 40.00% (0.0400 => 0.0560, std.dev.: 0.0019)
SingleSource/UnitTests/SignlessTypes/factor: 33.33% (0.0360 => 0.0480, std.dev.: 0.0000)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 26.32% (0.0760 => 0.0960, std.dev.: 0.0000)
SingleSource/Benchmarks/McGill/misr: 17.65% (0.0680 => 0.0800, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.39% (0.0920 => 0.1080, std.dev.: 0.0033)
MultiSource/Benchmarks/Olden/bisort/bisort: 16.67% (0.0720 => 0.0840)
SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840)
SingleSource/UnitTests/SignlessTypes/rem: 12.90% (0.1240 => 0.1400, std.dev.: 0.0050)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.50% (0.0960 => 0.1080, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/strcat: 10.91% (0.2200 => 0.2440, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.71% (0.1120 => 0.1240, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0038)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.57% (0.2800 => 0.3040, std.dev.: 0.0019)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 7.89% (0.1520 => 0.1640, std.dev.: 0.0019)
MultiSource/Benchmarks/Olden/health/health: 7.14% (0.1680 => 0.1800, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/ackermann: 5.45% (0.2200 => 0.2320, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.06% (0.3160 => 0.3320, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2480 => 0.2600, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.33% (1.2001 => 1.2281, std.dev.: 0.0033)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.25% (0.7120 => 0.7280, std.dev.: 0.0000)
MultiSource/Benchmarks/nbench/nbench: 2.24% (1.2520 => 1.2800, std.dev.: 0.0019)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.04% (1.3720 => 1.4000, std.dev.: 0.0100)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.79% (6.0320 => 6.1400, std.dev.: 0.0057)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9121 => 0.9281, std.dev.: 0.0019)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.69% (0.9441 => 0.9601, std.dev.: 0.0050)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.41% (1.1361 => 1.1521, std.dev.: 0.0050)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.40% (1.1441 => 1.1601, std.dev.: 0.0019)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1520 => 1.1680, std.dev.: 0.0050)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.37% (1.1681 => 1.1841, std.dev.: 0.0038)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 15.91% (0.1760 => 0.2040, std.dev.: 0.0086)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 12.66% (0.3160 => 0.3560, std.dev.: 0.0068)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 6.67% (0.2400 => 0.2560, std.dev.: 0.0050)
MultiSource/Benchmarks/llubenchmark/llu: 3.19% (5.3883 => 5.5603, std.dev.: 0.0459)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.56% (1.2481 => 1.2801, std.dev.: 0.0019)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.15% (2.4282 => 2.4562, std.dev.: 0.0033)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.15% (1.3961 => 1.4121, std.dev.: 0.0057)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Stanford/IntMM: -23.08% (0.0520 => 0.0400, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -14.29% (0.0840 => 0.0720, std.dev.: 0.0033)
MultiSource/Benchmarks/Prolangs-C++/objects/objects: -12.50% (0.0960 => 0.0840, std.dev.: 0.0038)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -8.33% (0.1920 => 0.1760, std.dev.: 0.0050)
MultiSource/Benchmarks/McCat/08-main/main: -6.10% (0.3280 => 0.3080, std.dev.: 0.0065)
MultiSource/Benchmarks/McCat/18-imp/imp: -4.63% (0.4320 => 0.4120, std.dev.: 0.0068)
SingleSource/UnitTests/Vector/constpool: -1.64% (11.2287 => 11.0447, std.dev.: 0.0098)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.74% (4.2403 => 4.1243, std.dev.: 0.0151)
Report Time: 2.08s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131206/27ec80f2/attachment.html>
More information about the llvm-testresults
mailing list