[llvm-testresults] pollyperf2__pollyperf-O3__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Tue Dec 3 22:49:38 PST 2013
http://llvm.org/perf/db_default/v4/nts/17933?compare_to=17928&baseline=17631
Nickname: pollyperf2__pollyperf-O3__clang_DEV__x86_64:20
Comparing:
Run: 17933, Order: 196353, Start Time: 2013-12-04 05:32:20, End Time: 2013-12-04 06:53:42
To: 17928, Order: 196344, Start Time: 2013-12-04 03:53:59, End Time: 2013-12-04 05:15:12
Baseline: 17631, Order: 195829, Start Time: 2013-11-27 09:28:54, End Time: 2013-11-27 10:53:00
===============
Tests Summary
===============
New Passes: 0 (1 on baseline)
Performance Regressions: 43 (48 on baseline)
Performance Improvements: 9 (9 on baseline)
Unchanged Tests: 1058 (1052 on baseline)
Total Tests: 1110
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/UnitTests/2002-08-02-CastTest2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038)
SingleSource/UnitTests/ms_struct_pack_layout-1: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038)
SingleSource/Regression/C++/2011-03-28-Bitfield: 250.00% (0.0080 => 0.0280, std.dev.: 0.0038)
SingleSource/Regression/C++/EH/simple_throw: 100.00% (0.0120 => 0.0240, std.dev.: 0.0000)
SingleSource/UnitTests/2005-05-12-Int64ToFP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
SingleSource/UnitTests/2007-04-10-BitfieldTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0019)
MultiSource/Benchmarks/BitBench/uuencode/uuencode: 36.36% (0.0440 => 0.0600, std.dev.: 0.0033)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.36% (0.0440 => 0.0600, std.dev.: 0.0033)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 30.00% (0.0400 => 0.0520, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0019)
SingleSource/Benchmarks/Misc/fbench: 16.67% (0.0720 => 0.0840, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.67% (0.0720 => 0.0840)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.79% (0.0760 => 0.0880, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout/lists: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038)
MultiSource/Benchmarks/Fhourstones/fhourstones: 12.82% (0.1560 => 0.1760, std.dev.: 0.0068)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.50% (0.1600 => 0.1800, std.dev.: 0.0057)
SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 11.43% (0.1400 => 0.1560, std.dev.: 0.0050)
MultiSource/Benchmarks/FreeBench/distray/distray: 9.68% (0.1240 => 0.1360)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.09% (0.2200 => 0.2400, std.dev.: 0.0038)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1960 => 0.2080, std.dev.: 0.0038)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.45% (1.1000 => 1.1600, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2360 => 0.2480, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.45% (0.3480 => 0.3600, std.dev.: 0.0000)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.91% (1.5120 => 1.5560, std.dev.: 0.0038)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.58% (1.3960 => 1.4320, std.dev.: 0.0068)
MultiSource/Applications/hbd/hbd: 2.38% (1.6800 => 1.7200, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.75% (1.1441 => 1.1641, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.50% (1.3321 => 1.3521, std.dev.: 0.0068)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.40% (1.1441 => 1.1601, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.36% (1.1801 => 1.1961, std.dev.: 0.0057)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.35% (1.1841 => 1.2001, std.dev.: 0.0033)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.10% (5.4360 => 5.4960, std.dev.: 0.0019)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038)
SingleSource/Benchmarks/Stanford/Treesort: 35.71% (0.0560 => 0.0760)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.64% (0.1760 => 0.2000, std.dev.: 0.0082)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.82% (2.4562 => 2.6482, std.dev.: 0.0173)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 7.79% (0.3080 => 0.3320, std.dev.: 0.0038)
MultiSource/Benchmarks/Olden/health/health: 7.37% (0.3800 => 0.4080, std.dev.: 0.0094)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (0.2440 => 0.2560, std.dev.: 0.0019)
MultiSource/Applications/viterbi/viterbi: 2.51% (2.7082 => 2.7762, std.dev.: 0.0086)
MultiSource/Benchmarks/Olden/bisort/bisort: 2.17% (0.7360 => 0.7520, std.dev.: 0.0000)
SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.9001 => 0.9161, std.dev.: 0.0038)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/2002-04-17-PrintfChar: -100.00% (0.0120 => 0.0000, std.dev.: 0.0033)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -18.18% (0.1320 => 0.1080, std.dev.: 0.0082)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -11.54% (0.1040 => 0.0920, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout-C++/strcat: -4.84% (0.2480 => 0.2360, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.04% (1.1521 => 1.1401, std.dev.: 0.0033)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Shootout/strcat: -15.79% (0.1520 => 0.1280, std.dev.: 0.0082)
MultiSource/Benchmarks/Olden/mst/mst: -12.90% (0.1240 => 0.1080, std.dev.: 0.0033)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.53% (5.8884 => 5.6804, std.dev.: 0.0435)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.07% (3.0042 => 2.9722, std.dev.: 0.0019)
================================
Run-Over-Baseline Changes Detail
================================
New Passes - Execution Time
---------------------------
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.94% (0.2720 => 0.2640, std.dev.: 0.0247)
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C++/short_circuit_dtor: 400.00% (0.0040 => 0.0200, std.dev.: 0.0019)
SingleSource/Regression/C/pointer_arithmetic: 300.00% (0.0040 => 0.0160, std.dev.: 0.0019)
SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0019)
SingleSource/UnitTests/2009-12-07-StructReturn: 300.00% (0.0040 => 0.0160, std.dev.: 0.0019)
SingleSource/UnitTests/ms_struct_pack_layout-1: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038)
SingleSource/UnitTests/2003-10-13-SwitchTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033)
SingleSource/UnitTests/ms_struct-bitfield-init: 133.33% (0.0120 => 0.0280, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout/hello: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038)
SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0000)
SingleSource/UnitTests/2003-07-10-SignConversions: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/UnitTests/2003-08-20-FoldBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
SingleSource/UnitTests/stmtexpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/UnitTests/2003-05-31-CastToBool: 80.00% (0.0200 => 0.0360, std.dev.: 0.0038)
SingleSource/Regression/C++/2011-03-28-Bitfield: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038)
SingleSource/Regression/C++/EH/ctor_dtor_count-2: 60.00% (0.0200 => 0.0320, std.dev.: 0.0019)
SingleSource/Benchmarks/Stanford/Treesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 33.33% (0.0600 => 0.0800, std.dev.: 0.0068)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 30.77% (0.0520 => 0.0680, std.dev.: 0.0019)
MultiSource/Benchmarks/BitBench/five11/five11: 28.57% (0.0560 => 0.0720, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 26.09% (0.0920 => 0.1160, std.dev.: 0.0019)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033)
MultiSource/Benchmarks/McCat/15-trie/trie: 21.43% (0.0560 => 0.0680, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 20.00% (0.0800 => 0.0960, std.dev.: 0.0019)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.1000 => 0.1200, std.dev.: 0.0050)
MultiSource/Benchmarks/Olden/tsp/tsp: 13.89% (0.1440 => 0.1640, std.dev.: 0.0019)
MultiSource/Benchmarks/Fhourstones/fhourstones: 12.82% (0.1560 => 0.1760, std.dev.: 0.0068)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038)
MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.34% (0.3480 => 0.3840, std.dev.: 0.0100)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.00% (0.1200 => 0.1320, std.dev.: 0.0019)
MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.59% (0.2920 => 0.3200, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.09% (0.2200 => 0.2400, std.dev.: 0.0038)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.57% (0.2800 => 0.3040, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/strcat: 7.27% (0.2200 => 0.2360, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0019)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.25% (0.2560 => 0.2720, std.dev.: 0.0033)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.85% (1.4840 => 1.5560, std.dev.: 0.0038)
MultiSource/Applications/hbd/hbd: 4.37% (1.6480 => 1.7200, std.dev.: 0.0019)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.84% (1.1280 => 1.1600, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.70% (1.1761 => 1.1961, std.dev.: 0.0057)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.26% (6.0320 => 6.1080, std.dev.: 0.0094)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 16.67% (0.1680 => 0.1960, std.dev.: 0.0105)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.64% (0.1760 => 0.2000, std.dev.: 0.0082)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.39% (0.3160 => 0.3520, std.dev.: 0.0065)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.25% (0.1920 => 0.2040)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.31% (0.4640 => 0.4840, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc/ffbench: 1.33% (0.9041 => 0.9161, std.dev.: 0.0038)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.32% (2.4282 => 2.4602, std.dev.: 0.0038)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/conditional-gnu-ext-cxx: -60.00% (0.0200 => 0.0080, std.dev.: 0.0038)
SingleSource/UnitTests/2002-05-03-NotTest: -42.86% (0.0280 => 0.0160, std.dev.: 0.0033)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: -23.53% (0.0680 => 0.0520, std.dev.: 0.0050)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.45% (0.3480 => 0.3360, std.dev.: 0.0033)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.65% (1.4560 => 1.4320, std.dev.: 0.0068)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.43% (1.9560 => 1.9280, std.dev.: 0.0050)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Olden/mst/mst: -10.00% (0.1200 => 0.1080, std.dev.: 0.0033)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.33% (1.2001 => 1.1841, std.dev.: 0.0050)
MultiSource/Applications/minisat/minisat: -1.06% (6.7684 => 6.6964, std.dev.: 0.0151)
Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131204/8f43269f/attachment.html>
More information about the llvm-testresults
mailing list