[llvm-testresults] pollyperf2pollyperf-O3clang_DEV__x86_64 test results

Thu Dec 12 10:05:12 PST 2013

http://llvm.org/perf/db_default/v4/nts/18323?compare_to=18318&baseline=17631
Nickname: pollyperf2__pollyperf-O3__clang_DEV__x86_64:20

Comparing:
     Run: 18323, Order: 197168, Start Time: 2013-12-12 16:48:17, End Time: 2013-12-12 18:09:28
      To: 18318, Order: 197154, Start Time: 2013-12-12 15:09:47, End Time: 2013-12-12 16:31:01
Baseline: 17631, Order: 195829, Start Time: 2013-11-27 09:28:54, End Time: 2013-11-27 10:53:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 41 (36 on baseline)
Performance Improvements: 19 (14 on baseline)
Unchanged Tests: 1050 (1059 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0019)
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++/mandel-text: 100.00% (0.0120 => 0.0240, std.dev.: 0.0000)
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
  SingleSource/Regression/C++/short_circuit_dtor: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033)
  SingleSource/Regression/C/2003-05-21-BitfieldHandling: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038)
  SingleSource/Regression/C++/global_ctor: 75.00% (0.0160 => 0.0280)
  SingleSource/UnitTests/2003-08-05-CastFPToUint: 75.00% (0.0160 => 0.0280)
  SingleSource/UnitTests/SignlessTypes/ccc: 66.67% (0.0240 => 0.0400, std.dev.: 0.0019)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 60.00% (0.0200 => 0.0320, std.dev.: 0.0019)
  SingleSource/Regression/C/testtrace: 60.00% (0.0200 => 0.0320)
  SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/fp-convert: 42.86% (0.0280 => 0.0400)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 36.36% (0.0440 => 0.0600, std.dev.: 0.0019)
  SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0019)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 29.41% (0.0680 => 0.0880, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 21.74% (0.0920 => 0.1120, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 17.39% (0.0920 => 0.1080, std.dev.: 0.0050)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.15% (0.2640 => 0.3040, std.dev.: 0.0068)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 12.00% (0.2000 => 0.2240, std.dev.: 0.0086)
  MultiSource/Benchmarks/Olden/em3d/em3d: 11.32% (0.2120 => 0.2360)
  SingleSource/Benchmarks/Stanford/Puzzle: 10.71% (0.1120 => 0.1240, std.dev.: 0.0019)
  MultiSource/Benchmarks/Olden/power/power: 10.53% (0.1520 => 0.1680, std.dev.: 0.0033)
  MultiSource/Benchmarks/FreeBench/distray/distray: 9.68% (0.1240 => 0.1360, std.dev.: 0.0019)
  SingleSource/UnitTests/SignlessTypes/rem: 9.38% (0.1280 => 0.1400, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/hello: 7.55% (0.2120 => 0.2280, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.91% (0.7440 => 0.7880, std.dev.: 0.0105)
  SingleSource/Benchmarks/Shootout-C++/lists1: 5.88% (0.3400 => 0.3600, std.dev.: 0.0033)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.17% (0.2320 => 0.2440, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.65% (0.3440 => 0.3600, std.dev.: 0.0019)
  MultiSource/Benchmarks/sim/sim: 4.60% (0.3480 => 0.3640, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 4.35% (0.3680 => 0.3840, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.94% (1.2361 => 1.2601, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.67% (1.2001 => 1.2201, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.63% (0.7360 => 0.7480, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.34% (1.1921 => 1.2081, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.87% (0.2520 => 0.2920, std.dev.: 0.0118)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.00% (0.3000 => 0.3360, std.dev.: 0.0118)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.62% (0.7400 => 0.7520, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.36% (2.3561 => 2.3881, std.dev.: 0.0050)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.04% (2.3161 => 2.3401, std.dev.: 0.0033)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2007-01-04-KNR-Args: -57.14% (0.0280 => 0.0120, std.dev.: 0.0050)
  SingleSource/Regression/C/2003-05-22-VarSizeArray: -50.00% (0.0240 => 0.0120, std.dev.: 0.0033)
  SingleSource/UnitTests/2003-08-11-VaListArg: -45.45% (0.0440 => 0.0240, std.dev.: 0.0065)
  SingleSource/UnitTests/Vector/divides: -42.86% (0.0280 => 0.0160, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -26.92% (0.1040 => 0.0760, std.dev.: 0.0068)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -13.04% (0.0920 => 0.0800, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -11.11% (0.1080 => 0.0960, std.dev.: 0.0038)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -10.81% (0.1480 => 0.1320, std.dev.: 0.0019)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -6.15% (0.2600 => 0.2440, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.81% (0.9440 => 0.9080, std.dev.: 0.0105)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.70% (0.3240 => 0.3120)
  MultiSource/Applications/lambda-0_1_3/lambda: -2.46% (0.8120 => 0.7920, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.30% (1.2161 => 1.1881, std.dev.: 0.0082)
  MultiSource/Benchmarks/MallocBench/gs/gs: -2.18% (4.9480 => 4.8400, std.dev.: 0.0383)
  MultiSource/Benchmarks/nbench/nbench: -2.17% (1.2920 => 1.2640, std.dev.: 0.0100)
  MultiSource/Applications/lemon/lemon: -1.59% (1.2601 => 1.2401, std.dev.: 0.0068)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.48% (8.0881 => 7.9681, std.dev.: 0.0334)
  SingleSource/UnitTests/Vector/constpool: -1.45% (11.0647 => 10.9047, std.dev.: 0.0414)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.03% (1.5600 => 1.5440, std.dev.: 0.0050)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.35% (0.2720 => 0.2920, std.dev.: 0.0118)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/short_circuit_dtor: 500.00% (0.0040 => 0.0240, std.dev.: 0.0033)
  SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0000)
  SingleSource/Regression/C++/global_ctor: 75.00% (0.0160 => 0.0280)
  SingleSource/UnitTests/SignlessTypes/ccc: 66.67% (0.0240 => 0.0400, std.dev.: 0.0019)
  SingleSource/Benchmarks/Stanford/Treesort: 62.50% (0.0320 => 0.0520, std.dev.: 0.0019)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 26.67% (0.0600 => 0.0760, std.dev.: 0.0019)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 20.00% (0.0800 => 0.0960, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.39% (0.0920 => 0.1080, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0019)
  SingleSource/UnitTests/SignlessTypes/rem: 12.90% (0.1240 => 0.1400, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/strcat: 10.91% (0.2200 => 0.2440, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/power/power: 10.53% (0.1520 => 0.1680, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0019)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.85% (0.2920 => 0.3120)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.17% (0.2320 => 0.2440, std.dev.: 0.0033)
  SingleSource/Regression/C++/ofstream_ctor: 5.17% (0.2320 => 0.2440, std.dev.: 0.0019)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (1.3720 => 1.4320, std.dev.: 0.0173)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.04% (1.4840 => 1.5440, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.82% (1.1361 => 1.1681, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.04% (1.1761 => 1.2001, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.01% (1.1961 => 1.2201, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.78% (0.6760 => 0.6880, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.75% (1.1441 => 1.1641, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.61% (1.2401 => 1.2601, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.31% (1.2201 => 1.2361, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.25% (1.2761 => 1.2921, std.dev.: 0.0033)
  MultiSource/Applications/oggenc/oggenc: 1.09% (5.5123 => 5.5723, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.13% (0.1240 => 0.1440)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 6.93% (1.3281 => 1.4201, std.dev.: 0.0353)
  SingleSource/Benchmarks/Shootout-C++/lists1: 5.88% (0.2720 => 0.2880, std.dev.: 0.0033)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.17% (0.7360 => 0.7520, std.dev.: 0.0019)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.32% (2.4282 => 2.4602, std.dev.: 0.0068)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.31% (5.5043 => 5.5763, std.dev.: 0.0100)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2003-08-11-VaListArg: -45.45% (0.0440 => 0.0240, std.dev.: 0.0065)
  SingleSource/UnitTests/2002-05-03-NotTest: -42.86% (0.0280 => 0.0160, std.dev.: 0.0038)
  SingleSource/UnitTests/Vector/divides: -42.86% (0.0280 => 0.0160, std.dev.: 0.0033)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -37.50% (0.0320 => 0.0200, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -17.65% (0.0680 => 0.0560, std.dev.: 0.0019)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -17.65% (0.0680 => 0.0560, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -13.04% (0.0920 => 0.0800, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.57% (6.0924 => 5.6924, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.81% (0.9440 => 0.9080, std.dev.: 0.0105)
  SingleSource/UnitTests/Vector/constpool: -2.89% (11.2287 => 10.9047, std.dev.: 0.0414)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.79% (1.1480 => 1.1160, std.dev.: 0.0115)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.38% (0.5040 => 0.4920, std.dev.: 0.0033)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -5.14% (1.3241 => 1.2561, std.dev.: 0.0200)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -4.91% (4.2403 => 4.0323, std.dev.: 0.0791)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131212/8d1737d1/attachment.html>

[llvm-testresults] pollyperf2__pollyperf-O3__clang_DEV__x86_64 test results

[llvm-testresults] pollyperf2pollyperf-O3clang_DEV__x86_64 test results