[llvm-testresults] pollyperf2__pollyperf-O3__clang_DEV__x86_64 test results

[llvm-testresults at cs.uiuc.edu]

http://llvm.org/perf/db_default/v4/nts/18002?compare_to=17997&baseline=17631
Nickname: pollyperf2__pollyperf-O3__clang_DEV__x86_64:20

Comparing:
     Run: 18002, Order: 196493, Start Time: 2013-12-05 11:31:04, End Time: 2013-12-05 12:52:28
      To: 17997, Order: 196488, Start Time: 2013-12-05 09:23:30, End Time: 2013-12-05 10:44:46
Baseline: 17631, Order: 195829, Start Time: 2013-11-27 09:28:54, End Time: 2013-11-27 10:53:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 41 (40 on baseline)
Performance Improvements: 20 (22 on baseline)
Unchanged Tests: 1049 (1047 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0019)
  SingleSource/UnitTests/2003-05-31-LongShifts: 150.00% (0.0080 => 0.0200)
  SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0019)
  SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0160 => 0.0320)
  SingleSource/Benchmarks/Misc/flops-7: 60.00% (0.0200 => 0.0320, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038)
  SingleSource/UnitTests/2002-05-02-CastTest: 60.00% (0.0200 => 0.0320, std.dev.: 0.0019)
  SingleSource/UnitTests/Vector/build: 60.00% (0.0200 => 0.0320)
  SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout/random: 44.44% (0.0360 => 0.0520, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/flops-6: 42.86% (0.0280 => 0.0400)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0019)
  SingleSource/UnitTests/SignlessTypes/factor: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/dt: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038)
  SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/hash: 18.75% (0.0640 => 0.0760)
  SingleSource/Benchmarks/Stanford/Puzzle: 18.52% (0.1080 => 0.1280, std.dev.: 0.0019)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.39% (0.0920 => 0.1080, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout/matrix: 16.67% (0.0720 => 0.0840, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.11% (0.1080 => 0.1200, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 11.11% (0.1080 => 0.1200, std.dev.: 0.0019)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.3920 => 0.4200, std.dev.: 0.0065)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.06% (0.3160 => 0.3320, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4200 => 0.4400, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.65% (0.3440 => 0.3600, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/moments: 3.77% (0.4240 => 0.4400, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.31% (0.7240 => 0.7480, std.dev.: 0.0033)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.29% (1.4000 => 1.4320, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.13% (1.1281 => 1.1521, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.03% (1.1801 => 1.2041, std.dev.: 0.0075)
  SingleSource/UnitTests/Vector/constpool: 2.03% (11.0327 => 11.2567, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.63% (1.2281 => 1.2481, std.dev.: 0.0050)
  MultiSource/Applications/treecc/treecc: 1.51% (2.3840 => 2.4200, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.30% (1.2281 => 1.2441, std.dev.: 0.0050)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: 27.27% (0.0440 => 0.0560, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 22.73% (0.0880 => 0.1080, std.dev.: 0.0050)
  MultiSource/Benchmarks/Olden/mst/mst: 14.29% (0.1120 => 0.1280, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 8.70% (0.1840 => 0.2000, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout-C++/lists1: 5.80% (0.2760 => 0.2920, std.dev.: 0.0019)
  MultiSource/Applications/lemon/lemon: 5.35% (0.9721 => 1.0241, std.dev.: 0.0173)
  MultiSource/Benchmarks/Olden/bisort/bisort: 1.65% (0.7280 => 0.7400, std.dev.: 0.0033)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2007-04-25-weak: -100.00% (0.0120 => 0.0000, std.dev.: 0.0033)
  SingleSource/UnitTests/2008-04-20-LoopBug2: -75.00% (0.0160 => 0.0040, std.dev.: 0.0038)
  SingleSource/Regression/C/2004-02-03-AggregateCopy: -66.67% (0.0240 => 0.0080, std.dev.: 0.0019)
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: -60.00% (0.0200 => 0.0080, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/flops-4: -41.67% (0.0480 => 0.0280, std.dev.: 0.0050)
  SingleSource/Benchmarks/SmallPT/smallpt: -13.16% (0.1520 => 0.1320, std.dev.: 0.0075)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -11.84% (0.3040 => 0.2680, std.dev.: 0.0118)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.52% (0.1680 => 0.1520, std.dev.: 0.0019)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.15% (0.2600 => 0.2440, std.dev.: 0.0033)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.15% (1.0400 => 0.9760, std.dev.: 0.0199)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.94% (0.3240 => 0.3080, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.06% (1.9440 => 1.9040, std.dev.: 0.0150)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.05% (1.7520 => 1.7160, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.98% (1.2121 => 1.1881, std.dev.: 0.0082)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.55% (4.9160 => 4.8400, std.dev.: 0.0136)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: -11.54% (0.1040 => 0.0920, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -7.37% (1.3561 => 1.2561, std.dev.: 0.0309)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -3.32% (4.1043 => 3.9682, std.dev.: 0.0488)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.39% (4.6003 => 4.5363, std.dev.: 0.0236)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.13% (1.4161 => 1.4001, std.dev.: 0.0050)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 1.47% (0.2720 => 0.2760, std.dev.: 0.0132)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/short_circuit_dtor: 400.00% (0.0040 => 0.0200, std.dev.: 0.0019)
  SingleSource/UnitTests/block-copied-in-cxxobj: 300.00% (0.0040 => 0.0160, std.dev.: 0.0019)
  SingleSource/Regression/C++/pointer_member: 200.00% (0.0080 => 0.0240, std.dev.: 0.0038)
  SingleSource/UnitTests/2003-10-13-SwitchTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0019)
  SingleSource/UnitTests/Vector/sumarray: 133.33% (0.0120 => 0.0280)
  SingleSource/UnitTests/2003-07-10-SignConversions: 100.00% (0.0120 => 0.0240, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 60.00% (0.0200 => 0.0320, std.dev.: 0.0019)
  SingleSource/UnitTests/2003-07-09-LoadShorts: 60.00% (0.0200 => 0.0320, std.dev.: 0.0019)
  SingleSource/UnitTests/Vector/build: 60.00% (0.0200 => 0.0320)
  SingleSource/Benchmarks/Shootout/random: 44.44% (0.0360 => 0.0520, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 40.00% (0.0600 => 0.0840, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc/flops-2: 37.50% (0.0320 => 0.0440, std.dev.: 0.0019)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 28.00% (0.1000 => 0.1280, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout/heapsort: 23.08% (0.0520 => 0.0640, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.05% (0.0760 => 0.0920, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.00% (0.1000 => 0.1200, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/hash: 18.75% (0.0640 => 0.0760)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.39% (0.0920 => 0.1080, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.04% (0.0920 => 0.1040, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/strcat: 10.91% (0.2200 => 0.2440, std.dev.: 0.0065)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.34% (0.3480 => 0.3840, std.dev.: 0.0086)
  SingleSource/Benchmarks/Stanford/Puzzle: 10.34% (0.1160 => 0.1280, std.dev.: 0.0019)
  SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0033)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.81% (0.2560 => 0.2760, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.06% (0.3160 => 0.3320, std.dev.: 0.0019)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (1.3720 => 1.4320, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.63% (0.7360 => 0.7480, std.dev.: 0.0033)
  MultiSource/Applications/obsequi/Obsequi: 1.62% (1.2360 => 1.2560, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.57% (1.2761 => 1.2961, std.dev.: 0.0057)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.17% (1.3720 => 1.3880, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.03% (1.1681 => 1.1801, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.02% (1.1761 => 1.1881, std.dev.: 0.0038)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.64% (0.1760 => 0.2000, std.dev.: 0.0057)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.00% (0.2400 => 0.2640, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/lists1: 7.35% (0.2720 => 0.2920, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/hash: 3.82% (0.5240 => 0.5440, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.77% (4.7363 => 4.8203, std.dev.: 0.0232)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.48% (2.4282 => 2.4642)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/2003-06-16-InvalidInitializer: -75.00% (0.0160 => 0.0040, std.dev.: 0.0038)
  SingleSource/UnitTests/2008-04-20-LoopBug2: -75.00% (0.0160 => 0.0040, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: -62.50% (0.0320 => 0.0120, std.dev.: 0.0068)
  SingleSource/Regression/C/2004-02-03-AggregateCopy: -60.00% (0.0200 => 0.0080, std.dev.: 0.0019)
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: -60.00% (0.0200 => 0.0080, std.dev.: 0.0038)
  SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: -60.00% (0.0200 => 0.0080)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -21.74% (0.0920 => 0.0720, std.dev.: 0.0068)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.12% (0.2640 => 0.2320, std.dev.: 0.0124)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -10.71% (0.1120 => 0.1000, std.dev.: 0.0038)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -10.67% (0.3000 => 0.2680, std.dev.: 0.0118)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.77% (1.4560 => 1.3720, std.dev.: 0.0290)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.24% (0.9440 => 0.9040, std.dev.: 0.0065)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.66% (1.9560 => 1.9040, std.dev.: 0.0150)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.38% (0.5040 => 0.4920, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.59% (1.2601 => 1.2401, std.dev.: 0.0075)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.57% (2.5402 => 2.5002, std.dev.: 0.0086)
  MultiSource/Applications/sqlite3/sqlite3: -1.08% (17.1050 => 16.9210, std.dev.: 0.0293)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -6.67% (1.2001 => 1.1201, std.dev.: 0.0142)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -3.30% (4.2403 => 4.1003, std.dev.: 0.0309)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -3.19% (1.1281 => 1.0921, std.dev.: 0.0132)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.48% (4.6043 => 4.5363, std.dev.: 0.0236)
  MultiSource/Applications/minisat/minisat: -1.24% (6.7684 => 6.6844, std.dev.: 0.0186)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131205/d81c8694/attachment.html>