[llvm-testresults] pollyperf2__pollyperf-O3__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Thu Dec 5 19:33:02 PST 2013
http://llvm.org/perf/db_default/v4/nts/18039?compare_to=18035&baseline=17631
Nickname: pollyperf2__pollyperf-O3__clang_DEV__x86_64:20
Comparing:
Run: 18039, Order: 196558, Start Time: 2013-12-06 02:15:57, End Time: 2013-12-06 03:37:09
To: 18035, Order: 196549, Start Time: 2013-12-06 00:37:52, End Time: 2013-12-06 01:59:06
Baseline: 17631, Order: 195829, Start Time: 2013-11-27 09:28:54, End Time: 2013-11-27 10:53:00
===============
Tests Summary
===============
New Passes: 0 (1 on baseline)
Performance Regressions: 42 (40 on baseline)
Performance Improvements: 11 (10 on baseline)
Unchanged Tests: 1057 (1059 on baseline)
Total Tests: 1110
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/UnitTests/2002-05-19-DivTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033)
SingleSource/UnitTests/2003-05-02-DependentPHI: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/UnitTests/stmtexpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout/sieve: 80.00% (0.0200 => 0.0360, std.dev.: 0.0019)
SingleSource/UnitTests/2002-08-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0019)
SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 60.00% (0.0200 => 0.0320, std.dev.: 0.0019)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 57.14% (0.0280 => 0.0440, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0019)
SingleSource/Regression/C/sumarraymalloc: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 37.50% (0.0640 => 0.0880, std.dev.: 0.0033)
MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0019)
SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0019)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0019)
SingleSource/Benchmarks/Stanford/FloatMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0033)
MultiSource/Benchmarks/Olden/bisort/bisort: 17.65% (0.0680 => 0.0800, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 16.67% (0.0960 => 0.1120, std.dev.: 0.0050)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 15.79% (0.0760 => 0.0880, std.dev.: 0.0000)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038)
SingleSource/UnitTests/2006-12-11-LoadConstants: 9.38% (0.1280 => 0.1400, std.dev.: 0.0019)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.71% (0.2800 => 0.2960, std.dev.: 0.0050)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.32% (0.3760 => 0.3960, std.dev.: 0.0000)
SingleSource/Benchmarks/Shootout-C++/strcat: 5.00% (0.2400 => 0.2520, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc/oourafft: 4.76% (0.2520 => 0.2640, std.dev.: 0.0019)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.17% (0.2880 => 0.3000, std.dev.: 0.0033)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.39% (0.8361 => 0.8561, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.19% (1.2761 => 1.3041, std.dev.: 0.0050)
MultiSource/Applications/minisat/minisat: 2.07% (0.7720 => 0.7880, std.dev.: 0.0050)
MultiSource/Applications/siod/siod: 1.76% (2.5041 => 2.5481, std.dev.: 0.0033)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.71% (0.7000 => 0.7120, std.dev.: 0.0038)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.57% (1.5240 => 1.5480, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.36% (1.1761 => 1.1921, std.dev.: 0.0033)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.31% (1.5280 => 1.5480, std.dev.: 0.0050)
MultiSource/Applications/lemon/lemon: 1.29% (1.2441 => 1.2601, std.dev.: 0.0050)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.05% (1.1481 => 1.1601, std.dev.: 0.0033)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout-C++/strcat: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057)
SingleSource/Benchmarks/Misc-C++/bigfib: 8.33% (0.2880 => 0.3120, std.dev.: 0.0050)
MultiSource/Benchmarks/llubenchmark/llu: 4.37% (5.3043 => 5.5363, std.dev.: 0.0737)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.42% (5.4523 => 5.5843, std.dev.: 0.0360)
SingleSource/Benchmarks/Misc-C++/Large/ray: 1.80% (4.8763 => 4.9643, std.dev.: 0.0100)
MultiSource/Benchmarks/Olden/power/power: 1.51% (1.3281 => 1.3481, std.dev.: 0.0000)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.07% (6.3364 => 6.4044, std.dev.: 0.0229)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Misc/lowercase: -44.44% (0.0360 => 0.0200, std.dev.: 0.0050)
SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: -42.86% (0.0280 => 0.0160, std.dev.: 0.0019)
SingleSource/Regression/C++/EH/simple_rethrow: -37.50% (0.0320 => 0.0200, std.dev.: 0.0038)
SingleSource/Regression/C++/EH/throw_rethrow_test: -37.50% (0.0320 => 0.0200, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc/flops-4: -36.36% (0.0440 => 0.0280, std.dev.: 0.0057)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -10.34% (0.1160 => 0.1040, std.dev.: 0.0033)
MultiSource/Benchmarks/Ptrdist/ks/ks: -8.00% (0.2000 => 0.1840, std.dev.: 0.0050)
SingleSource/Benchmarks/Shootout-C++/wc: -4.35% (0.2760 => 0.2640, std.dev.: 0.0019)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Olden/voronoi/voronoi: -14.67% (0.3000 => 0.2560, std.dev.: 0.0142)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -7.69% (0.1560 => 0.1440, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -6.91% (1.2161 => 1.1321, std.dev.: 0.0303)
================================
Run-Over-Baseline Changes Detail
================================
New Passes - Execution Time
---------------------------
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.88% (0.2720 => 0.2560, std.dev.: 0.0142)
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C/pointer_arithmetic: 300.00% (0.0040 => 0.0160)
SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0000)
SingleSource/UnitTests/2003-07-10-SignConversions: 100.00% (0.0120 => 0.0240, std.dev.: 0.0000)
SingleSource/UnitTests/stmtexpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout/sieve: 80.00% (0.0200 => 0.0360, std.dev.: 0.0019)
SingleSource/UnitTests/2002-08-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0019)
SingleSource/Benchmarks/Stanford/Treesort: 50.00% (0.0320 => 0.0480, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 40.00% (0.0600 => 0.0840, std.dev.: 0.0038)
SingleSource/Benchmarks/BenchmarkGame/partialsums: 33.33% (0.0360 => 0.0480, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout/random: 33.33% (0.0360 => 0.0480, std.dev.: 0.0019)
SingleSource/Benchmarks/Stanford/Queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0019)
SingleSource/Benchmarks/Misc/salsa20: 27.27% (0.0440 => 0.0560, std.dev.: 0.0019)
MultiSource/Benchmarks/BitBench/five11/five11: 21.43% (0.0560 => 0.0680, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 20.00% (0.0800 => 0.0960, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 16.67% (0.0960 => 0.1120, std.dev.: 0.0050)
SingleSource/Benchmarks/Shootout-C++/strcat: 14.55% (0.2200 => 0.2520, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc/whetstone: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.04% (0.0920 => 0.1040, std.dev.: 0.0033)
MultiSource/Benchmarks/Fhourstones/fhourstones: 12.82% (0.1560 => 0.1760, std.dev.: 0.0068)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.00% (0.1000 => 0.1120, std.dev.: 0.0033)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.90% (0.2320 => 0.2480, std.dev.: 0.0050)
SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0019)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.25% (0.2560 => 0.2720, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0038)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.32% (0.3760 => 0.3960, std.dev.: 0.0000)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.31% (1.4840 => 1.5480, std.dev.: 0.0050)
SingleSource/Benchmarks/Shootout-C++/ary2: 4.05% (0.2960 => 0.3080, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.19% (1.2761 => 1.3041, std.dev.: 0.0050)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.58% (1.2681 => 1.2881, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.49% (1.3441 => 1.3641, std.dev.: 0.0065)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.31% (1.2201 => 1.2361)
MultiSource/Applications/lemon/lemon: 1.29% (1.2441 => 1.2601, std.dev.: 0.0050)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.02% (1.1801 => 1.1921, std.dev.: 0.0033)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout-C++/strcat: 50.00% (0.0560 => 0.0840, std.dev.: 0.0057)
SingleSource/Benchmarks/Shootout-C++/moments: 20.83% (0.0960 => 0.1160)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.13% (0.1240 => 0.1440, std.dev.: 0.0033)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.25% (0.1920 => 0.2040)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.88% (1.2481 => 1.2841, std.dev.: 0.0098)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.32% (2.4282 => 2.4602, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.07% (6.3364 => 6.4044, std.dev.: 0.0229)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/ms_struct-bitfield-1: -75.00% (0.0160 => 0.0040, std.dev.: 0.0033)
MultiSource/Benchmarks/Prolangs-C++/NP/np: -37.50% (0.0320 => 0.0200, std.dev.: 0.0033)
SingleSource/Regression/C++/EH/throw_rethrow_test: -37.50% (0.0320 => 0.0200, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc/richards_benchmark: -17.39% (0.0920 => 0.0760, std.dev.: 0.0057)
MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.50% (0.0960 => 0.0840, std.dev.: 0.0038)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.57% (1.4560 => 1.4040, std.dev.: 0.0113)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Olden/bisort/bisort: -2.14% (0.7480 => 0.7320, std.dev.: 0.0050)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.98% (1.0081 => 0.9881, std.dev.: 0.0065)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.39% (4.6043 => 4.5403, std.dev.: 0.0170)
MultiSource/Applications/minisat/minisat: -1.06% (6.7684 => 6.6964, std.dev.: 0.0217)
Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131205/a53b8af1/attachment.html>
More information about the llvm-testresults
mailing list