[llvm-testresults] pollyperf2__pollyperf-O3__clang_DEV__x86_64 test results

[llvm-testresults at cs.uiuc.edu]

http://llvm.org/perf/db_default/v4/nts/18176?compare_to=18172&baseline=17631
Nickname: pollyperf2__pollyperf-O3__clang_DEV__x86_64:20

Comparing:
     Run: 18176, Order: 196748, Start Time: 2013-12-09 04:01:00, End Time: 2013-12-09 05:22:21
      To: 18172, Order: 196740, Start Time: 2013-12-09 01:08:10, End Time: 2013-12-09 02:29:47
Baseline: 17631, Order: 195829, Start Time: 2013-11-27 09:28:54, End Time: 2013-11-27 10:53:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 46 (60 on baseline)
Performance Improvements: 14 (8 on baseline)
Unchanged Tests: 1050 (1041 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/pointer_arithmetic: 300.00% (0.0040 => 0.0160, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/pi: 166.67% (0.0120 => 0.0320)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200)
  SingleSource/Regression/C++/BuiltinTypeInfo: 100.00% (0.0160 => 0.0320, std.dev.: 0.0019)
  SingleSource/UnitTests/TestLoop: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
  SingleSource/UnitTests/SignlessTypes/cast2: 75.00% (0.0160 => 0.0280)
  SingleSource/UnitTests/SignlessTypes/div: 71.43% (0.0280 => 0.0480, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout/strcat: 66.67% (0.0240 => 0.0400, std.dev.: 0.0019)
  SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0019)
  SingleSource/UnitTests/Vector/build2: 50.00% (0.0320 => 0.0480, std.dev.: 0.0000)
  SingleSource/Regression/C/sumarraymalloc: 42.86% (0.0280 => 0.0400)
  SingleSource/Regression/C/test_indvars: 42.86% (0.0280 => 0.0400)
  MultiSource/Benchmarks/Prolangs-C++/family/family: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038)
  SingleSource/Benchmarks/Dhrystone/fldry: 25.00% (0.0480 => 0.0600, std.dev.: 0.0019)
  SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0019)
  SingleSource/Benchmarks/McGill/misr: 23.53% (0.0680 => 0.0840, std.dev.: 0.0019)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 18.75% (0.0640 => 0.0760, std.dev.: 0.0019)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.67% (0.0960 => 0.1120, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout/lists: 15.79% (0.0760 => 0.0880, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 12.50% (0.0960 => 0.1080, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.54% (0.1040 => 0.1160, std.dev.: 0.0038)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.11% (0.1080 => 0.1200, std.dev.: 0.0038)
  MultiSource/Benchmarks/FreeBench/neural/neural: 8.89% (0.1800 => 0.1960, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.76% (0.3360 => 0.3520, std.dev.: 0.0038)
  MultiSource/Benchmarks/sim/sim: 4.65% (0.3440 => 0.3600, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/ary3: 4.05% (0.2960 => 0.3080, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/sieve: 3.66% (0.3280 => 0.3400, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.63% (0.7720 => 0.8000, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.30% (0.7280 => 0.7520, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 3.26% (0.3680 => 0.3800, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.7480 => 0.7720, std.dev.: 0.0038)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.97% (0.4040 => 0.4160, std.dev.: 0.0033)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.35% (4.7720 => 4.8840, std.dev.: 0.0197)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.99% (1.2080 => 1.2320, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.95% (1.2281 => 1.2521, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.86% (1.7200 => 1.7520, std.dev.: 0.0075)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.48% (4.8800 => 4.9520, std.dev.: 0.0254)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.46% (1.3680 => 1.3880, std.dev.: 0.0050)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 21.21% (0.1320 => 0.1600, std.dev.: 0.0038)
  MultiSource/Applications/JM/ldecod/ldecod: 18.75% (0.0640 => 0.0760, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.81% (0.3440 => 0.3640, std.dev.: 0.0033)
  MultiSource/Benchmarks/llubenchmark/llu: 3.17% (5.3003 => 5.4683, std.dev.: 0.0636)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.86% (28.6938 => 29.5138, std.dev.: 0.1552)
  MultiSource/Benchmarks/Olden/bisort/bisort: 1.64% (0.7320 => 0.7440, std.dev.: 0.0038)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/uint64_to_float: -46.15% (0.0520 => 0.0280, std.dev.: 0.0086)
  SingleSource/Regression/C/PR10189: -33.33% (0.0360 => 0.0240, std.dev.: 0.0019)
  MultiSource/Benchmarks/Olden/bisort/bisort: -25.00% (0.0800 => 0.0600, std.dev.: 0.0075)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -16.67% (0.0960 => 0.0800, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -9.88% (0.3240 => 0.2920, std.dev.: 0.0118)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -9.09% (0.3960 => 0.3600, std.dev.: 0.0068)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -9.09% (0.1320 => 0.1200, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.67% (0.4800 => 0.4480, std.dev.: 0.0105)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.25% (0.7120 => 0.6960, std.dev.: 0.0050)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/lists1: -9.59% (0.2920 => 0.2640, std.dev.: 0.0105)
  MultiSource/Applications/ClamAV/clamscan: -9.37% (0.1280 => 0.1160, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -5.21% (4.2963 => 4.0723, std.dev.: 0.0702)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.74% (2.6282 => 2.5562, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout-C++/sieve: -1.00% (2.3881 => 2.3641, std.dev.: 0.0068)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi
  MultiSource/Benchmarks/Olden/voronoi/voronoi: - (0.2720 => 0.2720, std.dev.: 0.0161)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/pointer_arithmetic: 300.00% (0.0040 => 0.0160, std.dev.: 0.0019)
  SingleSource/UnitTests/2002-04-17-PrintfChar: 300.00% (0.0040 => 0.0160, std.dev.: 0.0019)
  SingleSource/UnitTests/2007-04-25-weak: 300.00% (0.0040 => 0.0160, std.dev.: 0.0019)
  SingleSource/UnitTests/ms_struct_pack_layout-1: 300.00% (0.0040 => 0.0160)
  SingleSource/Regression/C++/pointer_member: 200.00% (0.0080 => 0.0240, std.dev.: 0.0000)
  SingleSource/UnitTests/2003-10-13-SwitchTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0019)
  SingleSource/UnitTests/conditional-gnu-ext: 150.00% (0.0080 => 0.0200, std.dev.: 0.0019)
  SingleSource/UnitTests/member-function-pointers: 133.33% (0.0120 => 0.0280, std.dev.: 0.0019)
  SingleSource/Regression/C/2003-05-22-LocalTypeTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/sieve: 80.00% (0.0200 => 0.0360, std.dev.: 0.0033)
  SingleSource/Regression/C++/BuiltinTypeInfo: 60.00% (0.0200 => 0.0320, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 53.33% (0.0600 => 0.0920, std.dev.: 0.0038)
  SingleSource/Regression/C/test_indvars: 42.86% (0.0280 => 0.0400)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 36.36% (0.0440 => 0.0600, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/flops-4: 33.33% (0.0360 => 0.0480, std.dev.: 0.0019)
  SingleSource/UnitTests/SignlessTypes/div: 33.33% (0.0360 => 0.0480, std.dev.: 0.0000)
  SingleSource/Benchmarks/Stanford/Queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/salsa20: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038)
  SingleSource/Benchmarks/McGill/misr: 23.53% (0.0680 => 0.0840, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 20.00% (0.0800 => 0.0960, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 19.05% (0.0840 => 0.1000, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.39% (0.0920 => 0.1080, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.00% (0.1000 => 0.1160, std.dev.: 0.0038)
  SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 12.50% (0.0960 => 0.1080, std.dev.: 0.0019)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.00% (0.1000 => 0.1120, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/strcat: 10.91% (0.2200 => 0.2440, std.dev.: 0.0068)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.00% (0.1200 => 0.1320, std.dev.: 0.0019)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.81% (0.2560 => 0.2760, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2200 => 0.2360, std.dev.: 0.0019)
  MultiSource/Benchmarks/Olden/health/health: 7.14% (0.1680 => 0.1800, std.dev.: 0.0033)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 6.67% (0.1800 => 0.1920, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2320 => 0.2440, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.73% (0.6760 => 0.7080, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.71% (0.7640 => 0.8000, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.76% (0.7440 => 0.7720, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.23% (1.4840 => 1.5320, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.46% (1.1361 => 1.1641, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.17% (0.7360 => 0.7520, std.dev.: 0.0019)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.06% (6.0320 => 6.1560, std.dev.: 0.0068)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.99% (1.2080 => 1.2320, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.97% (1.2201 => 1.2441, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.73% (4.8680 => 4.9520, std.dev.: 0.0254)
  MultiSource/Applications/lemon/lemon: 1.61% (1.2441 => 1.2641)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.57% (1.2761 => 1.2961, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.39% (1.7280 => 1.7520, std.dev.: 0.0075)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.17% (1.3720 => 1.3880, std.dev.: 0.0050)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 29.03% (0.1240 => 0.1600, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/ary2: 25.00% (0.0480 => 0.0600, std.dev.: 0.0019)
  MultiSource/Applications/JM/ldecod/ldecod: 18.75% (0.0640 => 0.0760, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 15.91% (0.1760 => 0.2040, std.dev.: 0.0068)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.19% (0.3160 => 0.3640, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 13.33% (0.2400 => 0.2720, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/moments: 12.50% (0.0960 => 0.1080, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/hash: 4.58% (0.5240 => 0.5480, std.dev.: 0.0019)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.35% (0.7360 => 0.7680, std.dev.: 0.0105)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.56% (1.2481 => 1.2801, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.86% (28.9738 => 29.5138, std.dev.: 0.1552)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.48% (2.4282 => 2.4642)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/2003-05-21-BitfieldHandling: -60.00% (0.0200 => 0.0080, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -20.83% (0.1920 => 0.1520, std.dev.: 0.0136)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.96% (6.0924 => 5.6684, std.dev.: 0.0278)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.38% (0.5040 => 0.4920, std.dev.: 0.0033)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -3.03% (2.6362 => 2.5562, std.dev.: 0.0057)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -1.76% (1.1361 => 1.1161, std.dev.: 0.0057)
  MultiSource/Applications/sqlite3/sqlite3: -1.19% (4.0323 => 3.9842, std.dev.: 0.0173)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.14% (17.2531 => 17.0571, std.dev.: 0.0709)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131208/e789af07/attachment.html>