[llvm-testresults] pollyperf3__pollyperf-O3-polly__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Tue Dec 10 01:24:37 PST 2013
http://llvm.org/perf/db_default/v4/nts/18240?compare_to=18220&baseline=18220
Nickname: pollyperf3__pollyperf-O3-polly__clang_DEV__x86_64:22
Comparing:
Run: 18240, Order: 196889, Start Time: 2013-12-10 07:36:46, End Time: 2013-12-10 09:28:50
To: 18220, Order: 196823, Start Time: 2013-12-09 21:35:20, End Time: 2013-12-09 23:27:31
Baseline: 18220, Order: 196823, Start Time: 2013-12-09 21:35:20, End Time: 2013-12-09 23:27:31
===============
Tests Summary
===============
Performance Regressions: 50 (50 on baseline)
Performance Improvements: 9 (9 on baseline)
Existing Failures: 2 (2 on baseline)
Unchanged Tests: 1049 (1049 on baseline)
Total Tests: 1110
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Shootout/fib2: 166.67% (0.0120 => 0.0320)
SingleSource/Regression/C++/2003-05-14-array-init: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/Regression/C++/pointer_member: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
SingleSource/UnitTests/2007-03-02-VaCopy: 100.00% (0.0120 => 0.0240, std.dev.: 0.0000)
SingleSource/Benchmarks/Misc/mandel-2: 83.33% (0.0240 => 0.0440, std.dev.: 0.0019)
SingleSource/Regression/C/2003-05-22-VarSizeArray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033)
SingleSource/UnitTests/2003-05-31-CastToBool: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 65.70% (0.9681 => 1.6041, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C++/primes/primes: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038)
SingleSource/UnitTests/ms_struct_pack_layout: 50.00% (0.0240 => 0.0360, std.dev.: 0.0019)
SingleSource/Regression/C/PR640: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033)
SingleSource/Benchmarks/Stanford/IntMM: 40.00% (0.0400 => 0.0560, std.dev.: 0.0057)
SingleSource/Benchmarks/Stanford/Quicksort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0033)
SingleSource/Benchmarks/Stanford/Towers: 33.33% (0.0480 => 0.0640, std.dev.: 0.0019)
SingleSource/Benchmarks/Misc/whetstone: 30.00% (0.1200 => 0.1560, std.dev.: 0.0019)
SingleSource/Benchmarks/McGill/misr: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057)
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 22.22% (0.0720 => 0.0880, std.dev.: 0.0050)
MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0050)
SingleSource/Benchmarks/Misc/flops: 17.46% (0.2520 => 0.2960, std.dev.: 0.0050)
MultiSource/Benchmarks/NPB-serial/is/is: 16.00% (0.1000 => 0.1160, std.dev.: 0.0019)
SingleSource/Regression/C/test_indvars: 13.04% (0.0920 => 0.1040, std.dev.: 0.0019)
MultiSource/Benchmarks/FreeBench/distray/distray: 9.68% (0.1240 => 0.1360, std.dev.: 0.0033)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.69% (0.2600 => 0.2800, std.dev.: 0.0065)
MultiSource/Benchmarks/Ptrdist/ft/ft: 7.25% (0.2760 => 0.2960, std.dev.: 0.0019)
SingleSource/Benchmarks/Misc/oourafft: 5.06% (0.3160 => 0.3320, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.00% (0.6400 => 0.6720, std.dev.: 0.0068)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.32% (0.7400 => 0.7720, std.dev.: 0.0068)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.47% (0.8080 => 0.8360, std.dev.: 0.0057)
MultiSource/Applications/lambda-0_1_3/lambda: 2.42% (0.8280 => 0.8480, std.dev.: 0.0065)
SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.5040 => 0.5160, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.13% (1.6921 => 1.7281, std.dev.: 0.0000)
MultiSource/Applications/SIBsim4/SIBsim4: 1.89% (1.6921 => 1.7241, std.dev.: 0.0038)
MultiSource/Benchmarks/Prolangs-C++/city/city: 1.83% (1.7520 => 1.7840, std.dev.: 0.0038)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (1.6401 => 1.6681, std.dev.: 0.0050)
SingleSource/Regression/C/sumarray2d: 1.69% (0.7080 => 0.7200, std.dev.: 0.0033)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.57% (2.0320 => 2.0640, std.dev.: 0.0050)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.53% (1.8321 => 1.8601, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.18% (1.6921 => 1.7121, std.dev.: 0.0019)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.15% (1.0441 => 1.0561)
MultiSource/Applications/spiff/spiff: 1.13% (1.0640 => 1.0760, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout/nestedloop: 1.11% (2.5202 => 2.5482, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.06% (1.8921 => 1.9121, std.dev.: 0.0068)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Applications/JM/ldecod/ldecod: 26.67% (0.0600 => 0.0760, std.dev.: 0.0019)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0019)
SingleSource/Benchmarks/Stanford/Treesort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 9.09% (0.1760 => 0.1920, std.dev.: 0.0057)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.45% (5.3843 => 5.5163, std.dev.: 0.0425)
MultiSource/Benchmarks/Olden/bisort/bisort: 1.62% (0.7400 => 0.7520, std.dev.: 0.0000)
SingleSource/Benchmarks/Misc/whetstone: 1.12% (1.4241 => 1.4401)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/printargs: -50.00% (0.0320 => 0.0160, std.dev.: 0.0050)
SingleSource/UnitTests/Vector/build2: -25.00% (0.0480 => 0.0360, std.dev.: 0.0019)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -16.67% (0.0720 => 0.0600, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -7.89% (0.1520 => 0.1400, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.55% (0.2640 => 0.2520, std.dev.: 0.0038)
SingleSource/Benchmarks/CoyoteBench/fftbench: -3.36% (0.4760 => 0.4600, std.dev.: 0.0057)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.85% (0.6480 => 0.6360, std.dev.: 0.0019)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -12.20% (0.1640 => 0.1440, std.dev.: 0.0050)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -10.81% (0.2960 => 0.2640, std.dev.: 0.0075)
Existing Failures - Compile Time
--------------------------------
MultiSource/Benchmarks/7zip/7zip-benchmark
MultiSource/Benchmarks/7zip/7zip-benchmark: 0.19% (50.6487 => 50.7448, std.dev.: 0.0344)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/sgefa/sgefa
MultiSource/Applications/sgefa/sgefa: - (0.2240 => 0.2240, std.dev.: 0.0019)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Shootout/fib2: 166.67% (0.0120 => 0.0320)
SingleSource/Regression/C++/2003-05-14-array-init: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/Regression/C++/pointer_member: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
SingleSource/UnitTests/2007-03-02-VaCopy: 100.00% (0.0120 => 0.0240, std.dev.: 0.0000)
SingleSource/Benchmarks/Misc/mandel-2: 83.33% (0.0240 => 0.0440, std.dev.: 0.0019)
SingleSource/Regression/C/2003-05-22-VarSizeArray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033)
SingleSource/UnitTests/2003-05-31-CastToBool: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 65.70% (0.9681 => 1.6041, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C++/primes/primes: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038)
SingleSource/UnitTests/ms_struct_pack_layout: 50.00% (0.0240 => 0.0360, std.dev.: 0.0019)
SingleSource/Regression/C/PR640: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033)
SingleSource/Benchmarks/Stanford/IntMM: 40.00% (0.0400 => 0.0560, std.dev.: 0.0057)
SingleSource/Benchmarks/Stanford/Quicksort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0033)
SingleSource/Benchmarks/Stanford/Towers: 33.33% (0.0480 => 0.0640, std.dev.: 0.0019)
SingleSource/Benchmarks/Misc/whetstone: 30.00% (0.1200 => 0.1560, std.dev.: 0.0019)
SingleSource/Benchmarks/McGill/misr: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057)
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 22.22% (0.0720 => 0.0880, std.dev.: 0.0050)
MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0050)
SingleSource/Benchmarks/Misc/flops: 17.46% (0.2520 => 0.2960, std.dev.: 0.0050)
MultiSource/Benchmarks/NPB-serial/is/is: 16.00% (0.1000 => 0.1160, std.dev.: 0.0019)
SingleSource/Regression/C/test_indvars: 13.04% (0.0920 => 0.1040, std.dev.: 0.0019)
MultiSource/Benchmarks/FreeBench/distray/distray: 9.68% (0.1240 => 0.1360, std.dev.: 0.0033)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.69% (0.2600 => 0.2800, std.dev.: 0.0065)
MultiSource/Benchmarks/Ptrdist/ft/ft: 7.25% (0.2760 => 0.2960, std.dev.: 0.0019)
SingleSource/Benchmarks/Misc/oourafft: 5.06% (0.3160 => 0.3320, std.dev.: 0.0019)
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.00% (0.6400 => 0.6720, std.dev.: 0.0068)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.32% (0.7400 => 0.7720, std.dev.: 0.0068)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.47% (0.8080 => 0.8360, std.dev.: 0.0057)
MultiSource/Applications/lambda-0_1_3/lambda: 2.42% (0.8280 => 0.8480, std.dev.: 0.0065)
SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.5040 => 0.5160, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.13% (1.6921 => 1.7281, std.dev.: 0.0000)
MultiSource/Applications/SIBsim4/SIBsim4: 1.89% (1.6921 => 1.7241, std.dev.: 0.0038)
MultiSource/Benchmarks/Prolangs-C++/city/city: 1.83% (1.7520 => 1.7840, std.dev.: 0.0038)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (1.6401 => 1.6681, std.dev.: 0.0050)
SingleSource/Regression/C/sumarray2d: 1.69% (0.7080 => 0.7200, std.dev.: 0.0033)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.57% (2.0320 => 2.0640, std.dev.: 0.0050)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.53% (1.8321 => 1.8601, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.18% (1.6921 => 1.7121, std.dev.: 0.0019)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.15% (1.0441 => 1.0561)
MultiSource/Applications/spiff/spiff: 1.13% (1.0640 => 1.0760, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout/nestedloop: 1.11% (2.5202 => 2.5482, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.06% (1.8921 => 1.9121, std.dev.: 0.0068)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Applications/JM/ldecod/ldecod: 26.67% (0.0600 => 0.0760, std.dev.: 0.0019)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0019)
SingleSource/Benchmarks/Stanford/Treesort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 9.09% (0.1760 => 0.1920, std.dev.: 0.0057)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.45% (5.3843 => 5.5163, std.dev.: 0.0425)
MultiSource/Benchmarks/Olden/bisort/bisort: 1.62% (0.7400 => 0.7520, std.dev.: 0.0000)
SingleSource/Benchmarks/Misc/whetstone: 1.12% (1.4241 => 1.4401)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/printargs: -50.00% (0.0320 => 0.0160, std.dev.: 0.0050)
SingleSource/UnitTests/Vector/build2: -25.00% (0.0480 => 0.0360, std.dev.: 0.0019)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -16.67% (0.0720 => 0.0600, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -7.89% (0.1520 => 0.1400, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.55% (0.2640 => 0.2520, std.dev.: 0.0038)
SingleSource/Benchmarks/CoyoteBench/fftbench: -3.36% (0.4760 => 0.4600, std.dev.: 0.0057)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.85% (0.6480 => 0.6360, std.dev.: 0.0019)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -12.20% (0.1640 => 0.1440, std.dev.: 0.0050)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -10.81% (0.2960 => 0.2640, std.dev.: 0.0075)
Existing Failures - Compile Time
--------------------------------
MultiSource/Benchmarks/7zip/7zip-benchmark
MultiSource/Benchmarks/7zip/7zip-benchmark: 0.19% (50.6487 => 50.7448, std.dev.: 0.0344)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/sgefa/sgefa
MultiSource/Applications/sgefa/sgefa: - (0.2240 => 0.2240, std.dev.: 0.0019)
Report Time: 0.28s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131210/c3063d21/attachment.html>
More information about the llvm-testresults
mailing list