[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Dec 18 05:55:39 PST 2013


http://llvm.org/perf/db_default/v4/nts/18566?compare_to=18562&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18566, Order: 197559, Start Time: 2013-12-18 12:20:08, End Time: 2013-12-18 14:00:02
      To: 18562, Order: 197554, Start Time: 2013-12-18 10:09:46, End Time: 2013-12-18 11:57:50
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 42 (52 on baseline)
Performance Improvements: 139 (83 on baseline)
Unchanged Tests: 929 (975 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.49% (1.2640 => 1.2828, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.08% (1.2098 => 1.2229, std.dev.: 0.0012)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 58.44% (1.6472 => 2.6099, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 36.53% (0.1459 => 0.1992, std.dev.: 0.0004)
  MultiSource/Benchmarks/Olden/em3d/em3d: 20.63% (4.5179 => 5.4499, std.dev.: 0.0003)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.68% (14.6041 => 16.4565, std.dev.: 0.6450)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.92% (3.1597 => 3.5363, std.dev.: 0.0027)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 9.49% (1.3745 => 1.5049, std.dev.: 0.0015)
  SingleSource/Benchmarks/McGill/misr: 8.88% (0.3772 => 0.4107, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.90% (3.5754 => 3.8577, std.dev.: 0.0009)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.71% (0.4304 => 0.4636, std.dev.: 0.0002)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.22% (1.9690 => 2.0915, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.19% (3.5030 => 3.7200, std.dev.: 0.0036)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.11% (2.8781 => 3.0539, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.52% (5.6297 => 5.9407, std.dev.: 0.0005)
  MultiSource/Benchmarks/sim/sim: 5.15% (3.8259 => 4.0228, std.dev.: 0.0084)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.58% (4.2163 => 4.4093, std.dev.: 0.0010)
  MultiSource/Applications/hexxagon/hexxagon: 4.13% (14.9884 => 15.6067, std.dev.: 0.0074)
  SingleSource/Benchmarks/Misc/fp-convert: 4.11% (7.5531 => 7.8635, std.dev.: 0.0060)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.98% (1.8247 => 1.8974, std.dev.: 0.0015)
  MultiSource/Applications/aha/aha: 3.92% (3.5665 => 3.7064, std.dev.: 0.0385)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.76% (5.8902 => 6.1119, std.dev.: 0.0043)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.52% (0.5090 => 0.5269, std.dev.: 0.0014)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.41% (0.6978 => 0.7216, std.dev.: 0.0023)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 3.17% (1.1569 => 1.1936, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.15% (5.0891 => 5.2496, std.dev.: 0.0080)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.11% (1.2557 => 1.2948, std.dev.: 0.0003)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 2.96% (0.5069 => 0.5219)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 2.83% (9.0811 => 9.3378, std.dev.: 0.0995)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.62% (3.7350 => 3.8329, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/oourafft: 2.47% (3.6394 => 3.7294, std.dev.: 0.0016)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.21% (1.6479 => 1.6844, std.dev.: 0.0043)
  MultiSource/Applications/sgefa/sgefa: 2.14% (0.8945 => 0.9136, std.dev.: 0.0030)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.10% (18.6279 => 19.0184, std.dev.: 0.0333)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.82% (23.3980 => 23.8227, std.dev.: 0.0117)
  SingleSource/Benchmarks/Shootout/fib2: 1.79% (3.5887 => 3.6529, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.76% (5.4976 => 5.5941, std.dev.: 0.0145)
  SingleSource/Benchmarks/Misc/mandel: 1.47% (1.0510 => 1.0665, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.36% (3.5383 => 3.5864, std.dev.: 0.0001)
  MultiSource/Applications/sqlite3/sqlite3: 1.35% (4.1441 => 4.2001, std.dev.: 0.0020)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.33% (3.1483 => 3.1901, std.dev.: 0.0037)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.32% (6.7539 => 6.8433, std.dev.: 0.0016)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/TestLoop: -49.07% (0.0216 => 0.0110, std.dev.: 0.0033)
  SingleSource/Benchmarks/Stanford/Quicksort: -42.23% (0.0682 => 0.0394, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/strcat: -30.69% (0.2975 => 0.2062, std.dev.: 0.0004)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -28.45% (0.5047 => 0.3611, std.dev.: 0.0041)
  SingleSource/Regression/C++/EH/exception_spec_test: -28.04% (0.0378 => 0.0272, std.dev.: 0.0035)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -25.68% (1.1963 => 0.8891, std.dev.: 0.0217)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -24.71% (0.1206 => 0.0908, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -23.83% (0.1150 => 0.0876, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -23.72% (0.3879 => 0.2959, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -23.33% (0.9455 => 0.7249, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -23.01% (0.8710 => 0.6706, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -22.97% (0.0492 => 0.0379, std.dev.: 0.0000)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -21.14% (0.0615 => 0.0485, std.dev.: 0.0003)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -19.68% (1.8281 => 1.4684, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc/fbench: -18.90% (0.0894 => 0.0725, std.dev.: 0.0008)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -18.08% (0.1582 => 0.1296, std.dev.: 0.0038)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -16.78% (0.2611 => 0.2173, std.dev.: 0.0045)
  MultiSource/Benchmarks/MallocBench/gs/gs: -15.57% (5.5059 => 4.6486, std.dev.: 0.0215)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -14.73% (0.0740 => 0.0631, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/em3d/em3d: -13.74% (0.2183 => 0.1883, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -13.62% (0.0778 => 0.0672, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.01% (0.1138 => 0.0990, std.dev.: 0.0004)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -12.59% (11.1569 => 9.7525, std.dev.: 0.0325)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -11.99% (6.2656 => 5.5144, std.dev.: 0.0336)
  SingleSource/UnitTests/Vector/constpool: -11.71% (10.1977 => 9.0038, std.dev.: 0.1915)
  SingleSource/Benchmarks/McGill/exptree: -11.61% (0.1051 => 0.0929, std.dev.: 0.0009)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.23% (1.2849 => 1.1406, std.dev.: 0.0065)
  MultiSource/Applications/obsequi/Obsequi: -10.42% (1.2939 => 1.1591, std.dev.: 0.0028)
  MultiSource/Benchmarks/nbench/nbench: -9.97% (1.3746 => 1.2376, std.dev.: 0.0059)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -9.77% (0.2906 => 0.2622, std.dev.: 0.0011)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.62% (1.2688 => 1.1467, std.dev.: 0.0030)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -9.46% (0.2897 => 0.2623, std.dev.: 0.0021)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -9.13% (0.2400 => 0.2181, std.dev.: 0.0004)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.42% (0.1830 => 0.1676, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -8.19% (0.6072 => 0.5575, std.dev.: 0.0060)
  MultiSource/Applications/viterbi/viterbi: -7.83% (0.2055 => 0.1894, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout-C++/objinst: -7.52% (0.2274 => 0.2103, std.dev.: 0.0015)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -7.49% (0.8941 => 0.8271, std.dev.: 0.0012)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.33% (1.1778 => 1.0915, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.24% (1.4163 => 1.3137, std.dev.: 0.0007)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.09% (2.1296 => 1.9786, std.dev.: 0.0022)
  MultiSource/Benchmarks/Olden/power/power: -7.04% (0.1449 => 0.1347, std.dev.: 0.0036)
  MultiSource/Applications/hbd/hbd: -6.97% (1.6737 => 1.5571, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.95% (5.8568 => 5.4498, std.dev.: 0.0029)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -6.82% (1.4050 => 1.3092, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.81% (0.7312 => 0.6814, std.dev.: 0.0137)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.43% (4.5028 => 4.2133, std.dev.: 0.0265)
  MultiSource/Applications/lua/lua: -6.39% (4.5744 => 4.2819, std.dev.: 0.0145)
  SingleSource/Benchmarks/Shootout-C++/hello: -6.08% (0.1908 => 0.1792, std.dev.: 0.0013)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -6.06% (0.1832 => 0.1721, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/ary: -5.94% (0.2641 => 0.2484, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.92% (1.5669 => 1.4741, std.dev.: 0.0023)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.88% (1.1600 => 1.0918, std.dev.: 0.0057)
  MultiSource/Applications/treecc/treecc: -5.76% (2.4113 => 2.2725, std.dev.: 0.0175)
  SingleSource/Benchmarks/Shootout-C++/hash2: -5.59% (0.4488 => 0.4237, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -5.58% (0.2025 => 0.1912, std.dev.: 0.0020)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.51% (0.9872 => 0.9328, std.dev.: 0.0139)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.46% (0.3626 => 0.3428, std.dev.: 0.0020)
  MultiSource/Applications/hexxagon/hexxagon: -5.36% (1.1011 => 1.0421, std.dev.: 0.0036)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.32% (0.7214 => 0.6830, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -4.90% (0.3754 => 0.3570, std.dev.: 0.0016)
  MultiSource/Applications/ClamAV/clamscan: -4.90% (17.6590 => 16.7937, std.dev.: 0.0591)
  MultiSource/Applications/sqlite3/sqlite3: -4.87% (23.2299 => 22.0995, std.dev.: 0.0286)
  SingleSource/Benchmarks/Shootout-C++/methcall: -4.78% (0.2135 => 0.2033, std.dev.: 0.0005)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -4.76% (0.4140 => 0.3943, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -4.70% (0.2214 => 0.2110, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/lists1: -4.67% (0.3236 => 0.3085, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.66% (2.9006 => 2.7655, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc/oourafft: -4.45% (0.2605 => 0.2489, std.dev.: 0.0015)
  MultiSource/Applications/oggenc/oggenc: -4.41% (5.9397 => 5.6778, std.dev.: 0.0390)
  SingleSource/Benchmarks/Shootout-C++/sieve: -4.37% (0.2974 => 0.2844, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout-C++/hash: -4.36% (0.4155 => 0.3974, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -4.28% (0.3320 => 0.3178, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.27% (0.3563 => 0.3411, std.dev.: 0.0025)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -4.20% (1.7186 => 1.6464, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.17% (0.3957 => 0.3792, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.10% (1.4138 => 1.3559, std.dev.: 0.0146)
  MultiSource/Applications/Burg/burg: -4.04% (1.4566 => 1.3978, std.dev.: 0.0213)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.99% (0.2754 => 0.2644, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.86% (0.9135 => 0.8782, std.dev.: 0.0044)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.82% (0.2908 => 0.2797, std.dev.: 0.0040)
  MultiSource/Benchmarks/McCat/09-vor/vor: -3.81% (0.3754 => 0.3611, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.76% (1.3784 => 1.3266, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.62% (0.5076 => 0.4892, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.35% (0.9170 => 0.8863, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.98% (1.7622 => 1.7096, std.dev.: 0.0075)
  MultiSource/Benchmarks/sim/sim: -2.97% (0.3810 => 0.3697, std.dev.: 0.0017)
  MultiSource/Applications/siod/siod: -2.76% (2.6691 => 2.5955, std.dev.: 0.0080)
  MultiSource/Applications/minisat/minisat: -2.61% (0.7845 => 0.7640, std.dev.: 0.0021)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.58% (1.4207 => 1.3841, std.dev.: 0.0051)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.56% (0.5868 => 0.5718, std.dev.: 0.0025)
  MultiSource/Benchmarks/Bullet/bullet: -2.40% (33.8521 => 33.0411, std.dev.: 0.0769)
  MultiSource/Applications/SPASS/SPASS: -2.38% (17.0210 => 16.6157, std.dev.: 0.0253)
  MultiSource/Applications/JM/ldecod/ldecod: -2.34% (7.7909 => 7.6083, std.dev.: 0.0124)
  MultiSource/Applications/lemon/lemon: -2.30% (1.3671 => 1.3357, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.65% (1.4133 => 1.3900, std.dev.: 0.0062)
  MultiSource/Applications/JM/lencod/lencod: -1.53% (17.6265 => 17.3573, std.dev.: 0.0220)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.36% (1.2397 => 1.2228, std.dev.: 0.0013)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (10.2265 => 10.0951, std.dev.: 0.0248)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.21% (7.3779 => 7.2889, std.dev.: 0.0114)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: -37.98% (1.2248 => 0.7596, std.dev.: 0.0049)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -35.84% (4.3984 => 2.8219, std.dev.: 0.0907)
  MultiSource/Applications/minisat/minisat: -22.77% (8.2261 => 6.3532, std.dev.: 0.0092)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -22.20% (5.8418 => 4.5449, std.dev.: 0.0247)
  SingleSource/Benchmarks/Shootout/heapsort: -22.10% (3.6699 => 2.8588, std.dev.: 0.1013)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -19.42% (1.8343 => 1.4780, std.dev.: 0.0926)
  MultiSource/Applications/SPASS/SPASS: -18.96% (9.9173 => 8.0369, std.dev.: 0.3616)
  SingleSource/Benchmarks/Shootout/ary3: -17.68% (5.2370 => 4.3109, std.dev.: 0.1836)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -15.48% (0.1602 => 0.1354, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout-C++/ary3: -15.21% (5.5726 => 4.7249, std.dev.: 0.1165)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -12.07% (4.3477 => 3.8229, std.dev.: 0.0782)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -10.85% (2.3578 => 2.1019, std.dev.: 0.0012)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -9.75% (0.1497 => 0.1351, std.dev.: 0.0017)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -9.15% (1.3623 => 1.2376, std.dev.: 0.0382)
  MultiSource/Applications/lemon/lemon: -9.00% (0.8990 => 0.8181, std.dev.: 0.0209)
  MultiSource/Benchmarks/llubenchmark/llu: -6.00% (2.0952 => 1.9694, std.dev.: 0.0060)
  MultiSource/Applications/obsequi/Obsequi: -5.24% (2.4738 => 2.3442, std.dev.: 0.0029)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.89% (2.4991 => 2.3769, std.dev.: 0.0339)
  SingleSource/Benchmarks/Shootout/hash: -4.79% (5.3897 => 5.1313, std.dev.: 0.0186)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.62% (61.9001 => 59.0407, std.dev.: 0.7858)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -4.13% (3.0405 => 2.9148, std.dev.: 0.0206)
  SingleSource/Benchmarks/McGill/chomp: -3.91% (1.0548 => 1.0136, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/methcall: -2.99% (7.9516 => 7.7141, std.dev.: 0.0124)
  SingleSource/Regression/C/uint64_to_float: -2.91% (1.5101 => 1.4661, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.89% (22.0731 => 21.4355, std.dev.: 0.1715)
  SingleSource/Benchmarks/Dhrystone/dry: -2.81% (0.4979 => 0.4839, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/lists1: -2.81% (0.6021 => 0.5852, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.70% (2.7468 => 2.6725, std.dev.: 0.0186)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.46% (1.2232 => 1.1931, std.dev.: 0.0022)
  MultiSource/Benchmarks/Olden/bisort/bisort: -2.46% (0.6800 => 0.6633, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.44% (3.8983 => 3.8032, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.33% (4.9440 => 4.8290, std.dev.: 0.0122)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.16% (4.1734 => 4.0832, std.dev.: 0.0240)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.76% (3.7105 => 3.6452, std.dev.: 0.0132)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -1.75% (2.3435 => 2.3024, std.dev.: 0.0145)
  SingleSource/Benchmarks/Misc/richards_benchmark: -1.69% (1.3812 => 1.3578, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/perlin: -1.64% (3.6687 => 3.6086, std.dev.: 0.0026)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.38% (41.4052 => 40.8343, std.dev.: 0.0792)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.02% (35.4791 => 35.1189, std.dev.: 0.0975)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 40.39% (15.7419 => 22.0995, std.dev.: 0.0286)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.77% (0.3859 => 0.4892, std.dev.: 0.0024)
  MultiSource/Applications/lemon/lemon: 9.48% (1.2200 => 1.3357, std.dev.: 0.0009)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.33% (25.9661 => 27.3505, std.dev.: 0.1205)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.95% (0.6412 => 0.6665, std.dev.: 0.0017)
  MultiSource/Applications/oggenc/oggenc: 3.29% (5.4968 => 5.6778, std.dev.: 0.0390)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.21% (1.5198 => 1.5686, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.34% (0.9915 => 1.0147, std.dev.: 0.0062)
  MultiSource/Applications/siod/siod: 1.82% (2.5491 => 2.5955, std.dev.: 0.0080)
  MultiSource/Applications/minisat/minisat: 1.42% (0.7533 => 0.7640, std.dev.: 0.0021)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.13% (5.0556 => 5.1125, std.dev.: 0.0047)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 56.42% (1.6685 => 2.6099, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/em3d/em3d: 18.16% (4.6123 => 5.4499, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.18% (5.9583 => 6.9222, std.dev.: 0.1629)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.96% (3.1585 => 3.5363, std.dev.: 0.0027)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.75% (1.3838 => 1.5049, std.dev.: 0.0015)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.32% (1.1019 => 1.1936, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.84% (3.5771 => 3.8577, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.81% (3.3810 => 3.6452, std.dev.: 0.0132)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.90% (2.8568 => 3.0539, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc/fp-convert: 6.42% (7.3892 => 7.8635, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.20% (3.5027 => 3.7200, std.dev.: 0.0036)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.01% (1.9729 => 2.0915, std.dev.: 0.0022)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.47% (1.2278 => 1.2949, std.dev.: 0.0037)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.38% (4.1840 => 4.4093, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout/lists: 4.92% (6.9930 => 7.3373, std.dev.: 0.0817)
  MultiSource/Applications/siod/siod: 4.89% (3.4258 => 3.5932, std.dev.: 0.0094)
  MultiSource/Applications/sgefa/sgefa: 4.47% (0.8745 => 0.9136, std.dev.: 0.0030)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (3.4043 => 3.5561, std.dev.: 0.0054)
  MultiSource/Applications/hexxagon/hexxagon: 4.05% (14.9989 => 15.6067, std.dev.: 0.0074)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.99% (0.6939 => 0.7216, std.dev.: 0.0023)
  MultiSource/Applications/aha/aha: 3.98% (3.5645 => 3.7064, std.dev.: 0.0385)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.89% (1.2463 => 1.2948, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.74% (5.0601 => 5.2496, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.37% (5.9126 => 6.1119, std.dev.: 0.0043)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.07% (0.5112 => 0.5269, std.dev.: 0.0014)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.07% (1.8409 => 1.8974, std.dev.: 0.0015)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.72% (3.7315 => 3.8329, std.dev.: 0.0012)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.44% (50.9650 => 52.2062, std.dev.: 0.2800)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.43% (0.4526 => 0.4636, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.31% (11.7894 => 12.0620, std.dev.: 0.0135)
  SingleSource/Benchmarks/Misc/oourafft: 2.17% (3.6501 => 3.7294, std.dev.: 0.0016)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.15% (18.6185 => 19.0184, std.dev.: 0.0333)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.82% (23.3972 => 23.8227, std.dev.: 0.0117)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.80% (1.7409 => 1.7723, std.dev.: 0.0067)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.78% (2.5025 => 2.5471, std.dev.: 0.0011)
  MultiSource/Applications/obsequi/Obsequi: 1.65% (2.3061 => 2.3442, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.65% (5.5032 => 5.5941, std.dev.: 0.0145)
  SingleSource/Benchmarks/Shootout/fib2: 1.58% (3.5960 => 3.6529, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.42% (3.1455 => 3.1901, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.16% (3.5451 => 3.5864, std.dev.: 0.0001)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.16% (2.3882 => 2.4158, std.dev.: 0.0039)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.74% (0.0688 => 0.0504, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -16.56% (0.1938 => 0.1617, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -10.41% (0.3402 => 0.3048, std.dev.: 0.0039)
  MultiSource/Benchmarks/Bullet/bullet: -9.79% (36.6274 => 33.0411, std.dev.: 0.0769)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.52% (1.0197 => 0.9328, std.dev.: 0.0139)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.55% (0.1523 => 0.1408, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.54% (1.5034 => 1.3900, std.dev.: 0.0062)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.44% (0.2540 => 0.2351, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.24% (5.8749 => 5.4498, std.dev.: 0.0029)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.12% (0.2824 => 0.2623, std.dev.: 0.0021)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.74% (0.2758 => 0.2572, std.dev.: 0.0028)
  MultiSource/Benchmarks/Olden/em3d/em3d: -6.74% (0.2019 => 0.1883, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.69% (0.1673 => 0.1561, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.59% (1.3676 => 1.2775, std.dev.: 0.0056)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.27% (2.0207 => 1.8941, std.dev.: 0.0455)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.91% (0.2810 => 0.2644, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.53% (1.3819 => 1.3055, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.35% (1.3146 => 1.2443, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.26% (1.4277 => 1.3526, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.22% (1.2824 => 1.2155, std.dev.: 0.0045)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.21% (1.1409 => 1.0815, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.01% (1.3505 => 1.2828, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.97% (1.4113 => 1.3411, std.dev.: 0.0003)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.85% (0.3714 => 0.3534, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.57% (1.5305 => 1.4606, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.49% (1.3024 => 1.2439, std.dev.: 0.0138)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.49% (0.2251 => 0.2150, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.39% (1.2914 => 1.2347, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.33% (1.3127 => 1.2559, std.dev.: 0.0015)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.21% (1.4449 => 1.3841, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.17% (1.3660 => 1.3091, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.12% (1.4125 => 1.3543, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.08% (15.4053 => 14.7765, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.07% (1.3157 => 1.2621, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.95% (1.2724 => 1.2222, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.66% (1.4074 => 1.3559, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.63% (1.2544 => 1.2089, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.62% (1.3264 => 1.2784, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.58% (1.2670 => 1.2216, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.51% (1.3918 => 1.3430, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.34% (1.3460 => 1.3011, std.dev.: 0.0097)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -3.32% (0.3735 => 0.3611, std.dev.: 0.0041)
  MultiSource/Benchmarks/McCat/05-eks/eks: -3.18% (0.5322 => 0.5153, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.15% (1.2785 => 1.2382, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.12% (1.3702 => 1.3275, std.dev.: 0.0097)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -3.07% (1.1767 => 1.1406, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.98% (1.3182 => 1.2789, std.dev.: 0.0011)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.98% (7.5124 => 7.2889, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.82% (1.2583 => 1.2228, std.dev.: 0.0013)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.74% (0.5879 => 0.5718, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.65% (4.7807 => 4.6542, std.dev.: 0.0435)
  MultiSource/Applications/obsequi/Obsequi: -2.64% (1.1905 => 1.1591, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.51% (1.3608 => 1.3266, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.38% (1.3457 => 1.3137, std.dev.: 0.0007)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.36% (0.6995 => 0.6830, std.dev.: 0.0063)
  MultiSource/Applications/d/make_dparser: -2.20% (3.6428 => 3.5626, std.dev.: 0.0133)
  MultiSource/Benchmarks/nbench/nbench: -2.14% (1.2647 => 1.2376, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.12% (1.3510 => 1.3224, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.10% (1.2952 => 1.2680, std.dev.: 0.0077)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.08% (10.3096 => 10.0951, std.dev.: 0.0248)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.99% (1.3551 => 1.3281, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -1.71% (0.7375 => 0.7249, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.65% (1.3068 => 1.2853, std.dev.: 0.0014)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.24% (1.3256 => 1.3092, std.dev.: 0.0041)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.21% (1.1608 => 1.1467, std.dev.: 0.0030)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.15% (1.6656 => 1.6464, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.03% (1.2356 => 1.2229, std.dev.: 0.0012)
  MultiSource/Applications/ClamAV/clamscan: -1.02% (16.9661 => 16.7937, std.dev.: 0.0591)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.61% (2.8850 => 2.3769, std.dev.: 0.0339)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -13.67% (1.4335 => 1.2376, std.dev.: 0.0382)
  MultiSource/Benchmarks/nbench/nbench: -8.58% (23.4696 => 21.4548, std.dev.: 0.4761)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -6.82% (10.0217 => 9.3378, std.dev.: 0.0995)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.12% (2.5559 => 2.3994, std.dev.: 0.0408)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -5.76% (4.0567 => 3.8229, std.dev.: 0.0782)
  MultiSource/Benchmarks/Bullet/bullet: -5.58% (7.4226 => 7.0084, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.56% (0.2894 => 0.2733, std.dev.: 0.0056)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.34% (61.0792 => 59.0407, std.dev.: 0.7858)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.86% (6.0535 => 5.8805, std.dev.: 0.0175)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.50% (3.6583 => 3.5667, std.dev.: 0.0317)
  MultiSource/Applications/sqlite3/sqlite3: -2.27% (4.2978 => 4.2001, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -2.11% (5.1947 => 5.0853, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout/hash: -1.12% (5.1896 => 5.1313, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.08% (4.1462 => 4.1016, std.dev.: 0.0002)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131218/e8ce8ed3/attachment.html>


More information about the llvm-testresults mailing list