[llvm-testresults] pollyperf2__pollyperf-O3__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Tue Dec 10 00:42:22 PST 2013
http://llvm.org/perf/db_default/v4/nts/18238?compare_to=18235&baseline=17631
Nickname: pollyperf2__pollyperf-O3__clang_DEV__x86_64:20
Comparing:
Run: 18238, Order: 196889, Start Time: 2013-12-10 07:25:14, End Time: 2013-12-10 08:46:35
To: 18235, Order: 196876, Start Time: 2013-12-10 05:47:14, End Time: 2013-12-10 07:08:26
Baseline: 17631, Order: 195829, Start Time: 2013-11-27 09:28:54, End Time: 2013-11-27 10:53:00
===============
Tests Summary
===============
New Passes: 0 (1 on baseline)
Performance Regressions: 56 (63 on baseline)
Performance Improvements: 14 (15 on baseline)
Unchanged Tests: 1040 (1031 on baseline)
Total Tests: 1110
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/UnitTests/SignlessTypes/cast2: 200.00% (0.0080 => 0.0240, std.dev.: 0.0019)
SingleSource/Regression/C/2003-05-21-UnionTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038)
SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280)
SingleSource/Regression/C/callargs: 75.00% (0.0160 => 0.0280, std.dev.: 0.0019)
SingleSource/UnitTests/2002-05-02-CastTest2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc/flops-8: 66.67% (0.0240 => 0.0400, std.dev.: 0.0019)
SingleSource/Regression/C++/EH/recursive-throw: 50.00% (0.0240 => 0.0360)
SingleSource/Regression/C/bigstack: 44.44% (0.0360 => 0.0520, std.dev.: 0.0019)
SingleSource/Benchmarks/Misc/matmul_f64_4x4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0019)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 33.33% (0.0360 => 0.0480, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 33.33% (0.0600 => 0.0800, std.dev.: 0.0057)
MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.75% (0.0640 => 0.0760, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 17.39% (0.0920 => 0.1080, std.dev.: 0.0038)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0000)
MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.29% (0.0840 => 0.0960, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc/whetstone: 13.04% (0.0920 => 0.1040, std.dev.: 0.0033)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.53% (0.2280 => 0.2520, std.dev.: 0.0033)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.00% (0.3600 => 0.3960, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.26% (0.2160 => 0.2360, std.dev.: 0.0019)
MultiSource/Benchmarks/Fhourstones/fhourstones: 7.69% (0.1560 => 0.1680, std.dev.: 0.0038)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.41% (0.3120 => 0.3320, std.dev.: 0.0065)
SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.81% (0.3440 => 0.3640, std.dev.: 0.0019)
MultiSource/Benchmarks/McCat/18-imp/imp: 4.90% (0.4080 => 0.4280, std.dev.: 0.0050)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.76% (1.5120 => 1.5840, std.dev.: 0.0068)
MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.55% (0.3520 => 0.3680, std.dev.: 0.0019)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.55% (0.2640 => 0.2760, std.dev.: 0.0038)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.24% (0.6600 => 0.6880, std.dev.: 0.0068)
SingleSource/Benchmarks/Shootout-C++/ary: 4.23% (0.2840 => 0.2960, std.dev.: 0.0038)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.92% (0.4080 => 0.4240, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.79% (1.1601 => 1.2041, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout-C++/moments: 3.67% (0.4360 => 0.4520, std.dev.: 0.0033)
MultiSource/Applications/lambda-0_1_3/lambda: 3.59% (0.7800 => 0.8080, std.dev.: 0.0057)
SingleSource/UnitTests/Vectorizer/gcc-loops: 2.99% (0.5360 => 0.5520, std.dev.: 0.0050)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.72% (0.5880 => 0.6040, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.56% (1.2481 => 1.2801, std.dev.: 0.0038)
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.44% (0.6560 => 0.6720, std.dev.: 0.0057)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.41% (1.1601 => 1.1881, std.dev.: 0.0057)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.07% (1.3521 => 1.3801, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.03% (1.1801 => 1.2041, std.dev.: 0.0057)
MultiSource/Applications/lua/lua: 1.95% (4.5120 => 4.6000, std.dev.: 0.0236)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.92% (2.0881 => 2.1281)
SingleSource/Benchmarks/Misc-C++/bigfib: 1.69% (0.7080 => 0.7200, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.60% (1.2481 => 1.2681)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.35% (1.1841 => 1.2001, std.dev.: 0.0038)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.7882 => 2.8242, std.dev.: 0.0100)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.25% (1.2841 => 1.3001, std.dev.: 0.0033)
MultiSource/Benchmarks/7zip/7zip-benchmark: 1.10% (47.1127 => 47.6287, std.dev.: 0.0803)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.01% (1.1921 => 1.2041, std.dev.: 0.0038)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.29% (0.0840 => 0.0960, std.dev.: 0.0019)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.25% (0.1920 => 0.2040)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.73% (2.3721 => 2.4842, std.dev.: 0.0113)
MultiSource/Applications/spiff/spiff: 3.33% (2.0401 => 2.1081, std.dev.: 0.0180)
MultiSource/Benchmarks/Olden/bisort/bisort: 2.19% (0.7320 => 0.7480, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.57% (2.5442 => 2.5842, std.dev.: 0.0142)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C++/EH/dead_try_block: -80.00% (0.0200 => 0.0040, std.dev.: 0.0050)
SingleSource/UnitTests/2002-10-12-StructureArgs: -66.67% (0.0240 => 0.0080, std.dev.: 0.0057)
SingleSource/UnitTests/2006-12-07-Compare64BitConstant: -50.00% (0.0240 => 0.0120, std.dev.: 0.0019)
SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -42.86% (0.0280 => 0.0160, std.dev.: 0.0038)
SingleSource/UnitTests/2003-07-09-SignedArgs: -27.27% (0.0440 => 0.0320)
MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.92% (0.4040 => 0.3720, std.dev.: 0.0050)
SingleSource/Benchmarks/Shootout-C++/sieve: -5.75% (0.3480 => 0.3280, std.dev.: 0.0075)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.30% (1.0560 => 1.0000, std.dev.: 0.0199)
MultiSource/Applications/spiff/spiff: -3.13% (1.0240 => 0.9920, std.dev.: 0.0118)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.26% (0.9561 => 0.9441, std.dev.: 0.0038)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -10.83% (1.2561 => 1.1201, std.dev.: 0.0478)
SingleSource/Benchmarks/Shootout-C++/lists1: -9.59% (0.2920 => 0.2640, std.dev.: 0.0082)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.86% (6.4324 => 6.2484, std.dev.: 0.0693)
MultiSource/Applications/obsequi/Obsequi: -1.51% (2.1241 => 2.0921, std.dev.: 0.0050)
================================
Run-Over-Baseline Changes Detail
================================
New Passes - Execution Time
---------------------------
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.41% (0.2720 => 0.2840, std.dev.: 0.0113)
Performance Regressions - Compile Time
--------------------------------------
SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 400.00% (0.0040 => 0.0200, std.dev.: 0.0019)
SingleSource/Regression/C++/global_type: 150.00% (0.0080 => 0.0200)
SingleSource/Regression/C++/global_ctor: 100.00% (0.0160 => 0.0320, std.dev.: 0.0019)
SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/UnitTests/member-function-pointers: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout/sieve: 80.00% (0.0200 => 0.0360, std.dev.: 0.0038)
SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 30.77% (0.0520 => 0.0680, std.dev.: 0.0038)
SingleSource/Benchmarks/Stanford/Queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038)
MultiSource/Benchmarks/BitBench/five11/five11: 21.43% (0.0560 => 0.0680, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.05% (0.0760 => 0.0920, std.dev.: 0.0050)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 20.00% (0.0800 => 0.0960, std.dev.: 0.0050)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.00% (0.1000 => 0.1160, std.dev.: 0.0033)
MultiSource/Benchmarks/Olden/power/power: 15.79% (0.1520 => 0.1760, std.dev.: 0.0075)
SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.29% (0.0840 => 0.0960, std.dev.: 0.0038)
SingleSource/Benchmarks/Misc/whetstone: 13.04% (0.0920 => 0.1040, std.dev.: 0.0033)
SingleSource/UnitTests/SignlessTypes/rem: 12.90% (0.1240 => 0.1400, std.dev.: 0.0050)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.50% (0.0960 => 0.1080, std.dev.: 0.0019)
MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.59% (0.2920 => 0.3200, std.dev.: 0.0098)
SingleSource/Benchmarks/Shootout-C++/strcat: 9.09% (0.2200 => 0.2400, std.dev.: 0.0050)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.62% (0.2320 => 0.2520, std.dev.: 0.0033)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.57% (0.2800 => 0.3040, std.dev.: 0.0086)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.18% (0.6360 => 0.6880, std.dev.: 0.0068)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.81% (0.2560 => 0.2760, std.dev.: 0.0038)
MultiSource/Benchmarks/Fhourstones/fhourstones: 7.69% (0.1560 => 0.1680, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2200 => 0.2360, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.3480 => 0.3720, std.dev.: 0.0050)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.74% (1.4840 => 1.5840, std.dev.: 0.0068)
MultiSource/Benchmarks/Ptrdist/ks/ks: 6.67% (0.1800 => 0.1920, std.dev.: 0.0033)
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.66% (0.6360 => 0.6720, std.dev.: 0.0057)
SingleSource/Benchmarks/Shootout-C++/ackermann: 5.45% (0.2200 => 0.2320, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout-C++/lists: 5.41% (0.2960 => 0.3120, std.dev.: 0.0038)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.32% (0.3760 => 0.3960, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0068)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.96% (1.3720 => 1.4400, std.dev.: 0.0118)
SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2480 => 0.2600, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout-C++/matrix: 4.48% (0.2680 => 0.2800, std.dev.: 0.0033)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.92% (0.4080 => 0.4240, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.4400 => 0.4560, std.dev.: 0.0038)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.55% (0.6760 => 0.7000, std.dev.: 0.0068)
MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.37% (0.3560 => 0.3680, std.dev.: 0.0019)
MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7880 => 0.8080, std.dev.: 0.0057)
MultiSource/Applications/hbd/hbd: 2.18% (1.6480 => 1.6840, std.dev.: 0.0131)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.11% (1.1361 => 1.1601, std.dev.: 0.0057)
MultiSource/Applications/lua/lua: 1.95% (4.5120 => 4.6000, std.dev.: 0.0236)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.93% (1.2441 => 1.2681)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.88% (1.2761 => 1.3001, std.dev.: 0.0033)
MultiSource/Benchmarks/nbench/nbench: 1.60% (1.2520 => 1.2720, std.dev.: 0.0068)
MultiSource/Applications/oggenc/oggenc: 1.60% (5.5123 => 5.6003, std.dev.: 0.0124)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.30% (1.2281 => 1.2441)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.17% (1.3641 => 1.3801, std.dev.: 0.0019)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 19.35% (0.1240 => 0.1480, std.dev.: 0.0082)
SingleSource/Benchmarks/Shootout-C++/moments: 16.67% (0.0960 => 0.1120, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 14.29% (0.1680 => 0.1920, std.dev.: 0.0082)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.13% (0.3160 => 0.3480, std.dev.: 0.0065)
SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 7.23% (1.3281 => 1.4241, std.dev.: 0.0199)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.25% (0.1920 => 0.2040)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.56% (1.2481 => 1.2801, std.dev.: 0.0094)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.32% (2.4282 => 2.4602, std.dev.: 0.0033)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C/2003-06-16-InvalidInitializer: -75.00% (0.0160 => 0.0040, std.dev.: 0.0038)
SingleSource/UnitTests/2002-05-02-ArgumentTest: -75.00% (0.0160 => 0.0040, std.dev.: 0.0038)
SingleSource/UnitTests/ms_struct-bitfield-1: -75.00% (0.0160 => 0.0040, std.dev.: 0.0033)
MultiSource/Benchmarks/Prolangs-C++/NP/np: -50.00% (0.0320 => 0.0160, std.dev.: 0.0050)
SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -50.00% (0.0320 => 0.0160, std.dev.: 0.0038)
SingleSource/UnitTests/2003-05-02-DependentPHI: -42.86% (0.0280 => 0.0160, std.dev.: 0.0038)
MultiSource/Benchmarks/McCat/04-bisect/bisect: -20.93% (0.1720 => 0.1360, std.dev.: 0.0105)
MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -17.65% (0.0680 => 0.0560, std.dev.: 0.0033)
MultiSource/Benchmarks/McCat/17-bintr/bintr: -16.67% (0.0960 => 0.0800, std.dev.: 0.0050)
SingleSource/Benchmarks/Misc/ffbench: -16.67% (0.0960 => 0.0800, std.dev.: 0.0050)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -10.42% (0.1920 => 0.1720, std.dev.: 0.0065)
SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.70% (6.0924 => 5.6844, std.dev.: 0.0082)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Fhourstones/fhourstones: -2.11% (1.1361 => 1.1121, std.dev.: 0.0082)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.97% (2.6362 => 2.5842, std.dev.: 0.0142)
SingleSource/Benchmarks/CoyoteBench/fftbench: -1.17% (2.3841 => 2.3561, std.dev.: 0.0105)
Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131210/f580874d/attachment.html>
More information about the llvm-testresults
mailing list