[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jan 10 06:04:35 PST 2014


http://llvm.org/perf/db_default/v4/nts/20198?compare_to=20193&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 20198, Order: 198936, Start Time: 2014-01-10 12:25:14, End Time: 2014-01-10 14:09:24
      To: 20193, Order: 198924, Start Time: 2014-01-10 10:02:52, End Time: 2014-01-10 11:59:07
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 27 (53 on baseline)
Performance Improvements: 24 (34 on baseline)
Unchanged Tests: 1059 (1023 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/constpool: 3.06% (8.9197 => 9.1923, std.dev.: 0.1044)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: 68.01% (0.3389 => 0.5694, std.dev.: 0.0105)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.16% (1.0205 => 1.1344, std.dev.: 0.0012)
  MultiSource/Benchmarks/Olden/em3d/em3d: 9.76% (4.9157 => 5.3953, std.dev.: 0.0260)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.77% (1.3906 => 1.4987, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc/ReedSolomon: 6.42% (9.1730 => 9.7620, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.14% (3.5038 => 3.7188, std.dev.: 0.0115)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.13% (0.4371 => 0.4639, std.dev.: 0.0002)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.96% (1.9816 => 2.0799, std.dev.: 0.0083)
  SingleSource/Benchmarks/Shootout/lists: 4.37% (7.1933 => 7.5079, std.dev.: 0.0044)
  MultiSource/Benchmarks/sim/sim: 3.72% (3.8427 => 3.9855, std.dev.: 0.0281)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.55% (0.6977 => 0.7225, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 3.46% (0.4716 => 0.4879, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.00% (5.9204 => 6.0979, std.dev.: 0.0094)
  MultiSource/Applications/aha/aha: 2.49% (3.6507 => 3.7416, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.33% (5.4963 => 5.6244, std.dev.: 0.0069)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.14% (1.6581 => 1.6936, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/heapsort: 2.13% (2.8909 => 2.9524, std.dev.: 0.0042)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.12% (2.4724 => 2.5249, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.03% (7.0763 => 7.2203, std.dev.: 0.0105)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 2.02% (23.3659 => 23.8375, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout/fib2: 1.81% (3.5885 => 3.6536, std.dev.: 0.0018)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.67% (6.7370 => 6.8492, std.dev.: 0.0011)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.51% (1.7229 => 1.7490, std.dev.: 0.0083)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.29% (1.6165 => 1.6374, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.25% (11.9325 => 12.0822, std.dev.: 0.0316)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.01% (11.9470 => 12.0676, std.dev.: 0.0249)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -24.23% (0.2154 => 0.1632, std.dev.: 0.0054)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -7.43% (0.2759 => 0.2554, std.dev.: 0.0049)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.21% (0.9689 => 0.8990, std.dev.: 0.0134)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.23% (0.2734 => 0.2591, std.dev.: 0.0055)
  MultiSource/Benchmarks/McCat/08-main/main: -4.45% (0.3214 => 0.3071, std.dev.: 0.0039)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -3.56% (0.6806 => 0.6564, std.dev.: 0.0057)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -3.39% (0.3803 => 0.3674, std.dev.: 0.0034)
  MultiSource/Benchmarks/McCat/05-eks/eks: -3.13% (0.5371 => 0.5203, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.85% (0.7025 => 0.6825, std.dev.: 0.0015)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.66% (1.4405 => 1.4022, std.dev.: 0.0054)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.52% (0.7422 => 0.7235, std.dev.: 0.0049)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.36% (1.1072 => 1.0811, std.dev.: 0.0066)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.75% (1.7368 => 1.7064, std.dev.: 0.0038)
  MultiSource/Benchmarks/MallocBench/gs/gs: -1.68% (4.7474 => 4.6678, std.dev.: 0.0066)
  MultiSource/Applications/hbd/hbd: -1.28% (1.5734 => 1.5532, std.dev.: 0.0038)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -16.94% (0.1612 => 0.1339, std.dev.: 0.0001)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -10.30% (0.1583 => 0.1420, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout/ary3: -9.12% (4.7501 => 4.3167, std.dev.: 0.1628)
  MultiSource/Applications/SPASS/SPASS: -8.78% (8.9169 => 8.1337, std.dev.: 0.1044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.59% (3.1083 => 2.9036, std.dev.: 0.0165)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -2.63% (2.3950 => 2.3321, std.dev.: 0.0061)
  MultiSource/Applications/sqlite3/sqlite3: -1.78% (4.3894 => 4.3112, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/ary3: -1.52% (4.7888 => 4.7160, std.dev.: 0.0154)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.18% (3.6726 => 3.6291, std.dev.: 0.0056)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 40.48% (15.7419 => 22.1146, std.dev.: 0.0727)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 28.04% (0.3859 => 0.4941, std.dev.: 0.0038)
  MultiSource/Applications/lemon/lemon: 9.67% (1.2200 => 1.3380, std.dev.: 0.0020)
  MultiSource/Applications/oggenc/oggenc: 3.64% (5.4968 => 5.6970, std.dev.: 0.0373)
  MultiSource/Benchmarks/McCat/09-vor/vor: 3.11% (0.3596 => 0.3708, std.dev.: 0.0015)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.40% (1.5198 => 1.5563, std.dev.: 0.0057)
  MultiSource/Applications/minisat/minisat: 2.39% (0.7533 => 0.7713, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.17% (0.9915 => 1.0130, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.88% (0.8787 => 0.8952, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.73% (5.0556 => 5.1433, std.dev.: 0.0095)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.69% (0.6322 => 0.6429, std.dev.: 0.0031)
  MultiSource/Applications/siod/siod: 1.53% (2.5491 => 2.5882, std.dev.: 0.0063)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 40.44% (2.8607 => 4.0175, std.dev.: 0.0032)
  MultiSource/Benchmarks/FreeBench/neural/neural: 34.93% (0.4220 => 0.5694, std.dev.: 0.0105)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 19.95% (5.9583 => 7.1472, std.dev.: 0.1616)
  SingleSource/Benchmarks/Shootout/matrix: 17.56% (1.7960 => 2.1114, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/em3d/em3d: 16.98% (4.6123 => 5.3953, std.dev.: 0.0260)
  SingleSource/Benchmarks/Misc/ReedSolomon: 14.83% (8.5010 => 9.7620, std.dev.: 0.0005)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.22% (82.2592 => 92.3117, std.dev.: 0.4220)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.87% (1.0232 => 1.1344, std.dev.: 0.0012)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.30% (1.3838 => 1.4987, std.dev.: 0.0046)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 8.01% (0.3534 => 0.3817, std.dev.: 0.0003)
  SingleSource/Benchmarks/Stanford/Puzzle: 7.61% (0.1668 => 0.1795, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout/lists: 7.36% (6.9930 => 7.5079, std.dev.: 0.0044)
  SingleSource/Benchmarks/McGill/chomp: 6.31% (1.0099 => 1.0736, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.17% (3.5027 => 3.7188, std.dev.: 0.0115)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 5.42% (1.9729 => 2.0799, std.dev.: 0.0083)
  MultiSource/Applications/siod/siod: 4.98% (3.4258 => 3.5965, std.dev.: 0.0033)
  MultiSource/Applications/aha/aha: 4.97% (3.5645 => 3.7416, std.dev.: 0.0061)
  SingleSource/Benchmarks/Misc/fp-convert: 4.72% (7.3892 => 7.7377, std.dev.: 0.0522)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.30% (0.6261 => 0.6530, std.dev.: 0.0001)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.12% (0.6939 => 0.7225, std.dev.: 0.0031)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.92% (4.1840 => 4.3479, std.dev.: 0.0289)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.13% (5.9126 => 6.0979, std.dev.: 0.0094)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.09% (5.4994 => 5.6693, std.dev.: 0.0196)
  SingleSource/Benchmarks/McGill/misr: 2.98% (0.4029 => 0.4149, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.73% (3.7315 => 3.8332, std.dev.: 0.0010)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.50% (0.4526 => 0.4639, std.dev.: 0.0002)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.43% (1.5986 => 1.6374, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.36% (11.7894 => 12.0676, std.dev.: 0.0249)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.20% (5.5032 => 5.6244, std.dev.: 0.0069)
  SingleSource/Benchmarks/Misc/oourafft: 2.09% (3.6501 => 3.7265, std.dev.: 0.0021)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.88% (23.3972 => 23.8375, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.81% (15.6810 => 15.9648, std.dev.: 0.0779)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.62% (3.1455 => 3.1963, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.61% (11.8902 => 12.0822, std.dev.: 0.0316)
  SingleSource/Benchmarks/Shootout/fib2: 1.60% (3.5960 => 3.6536, std.dev.: 0.0018)
  MultiSource/Applications/obsequi/Obsequi: 1.57% (2.3061 => 2.3423, std.dev.: 0.0053)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.43% (2.4894 => 2.5249, std.dev.: 0.0030)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.42% (1.6699 => 1.6936, std.dev.: 0.0015)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.39% (3.4043 => 3.4517, std.dev.: 0.0011)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.27% (2.3882 => 2.4186, std.dev.: 0.0054)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.09% (6.7756 => 6.8492, std.dev.: 0.0011)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.31% (0.0688 => 0.0507, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -14.45% (0.1938 => 0.1658, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.13% (0.1088 => 0.0956, std.dev.: 0.0016)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.49% (0.3402 => 0.3079, std.dev.: 0.0062)
  MultiSource/Benchmarks/Olden/em3d/em3d: -8.27% (0.2019 => 0.1852, std.dev.: 0.0059)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.00% (0.1774 => 0.1632, std.dev.: 0.0054)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.40% (0.2824 => 0.2615, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.09% (5.8749 => 5.4585, std.dev.: 0.0087)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.97% (0.2540 => 0.2363, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.42% (0.6882 => 0.6440, std.dev.: 0.0058)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.25% (2.0207 => 1.9146, std.dev.: 0.0049)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2691 => 0.2554, std.dev.: 0.0049)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.74% (0.9437 => 0.8990, std.dev.: 0.0134)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.18% (1.1409 => 1.0932, std.dev.: 0.0015)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.96% (1.4449 => 1.4022, std.dev.: 0.0054)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.52% (1.1767 => 1.1470, std.dev.: 0.0097)
  MultiSource/Applications/d/make_dparser: -2.41% (3.6428 => 3.5549, std.dev.: 0.0053)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.24% (0.5322 => 0.5203, std.dev.: 0.0021)
  MultiSource/Applications/obsequi/Obsequi: -2.07% (1.1905 => 1.1659, std.dev.: 0.0052)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -1.90% (0.7375 => 0.7235, std.dev.: 0.0049)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.69% (0.6942 => 0.6825, std.dev.: 0.0015)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.44% (0.6995 => 0.6894, std.dev.: 0.0010)
  MultiSource/Benchmarks/nbench/nbench: -1.39% (1.2647 => 1.2471, std.dev.: 0.0015)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -44.44% (0.0369 => 0.0205, std.dev.: 0.0031)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.01% (15.5356 => 12.8925, std.dev.: 0.2427)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -13.77% (1.4335 => 1.2361, std.dev.: 0.0367)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.44% (50.9650 => 45.1347, std.dev.: 1.3954)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -5.59% (2.9945 => 2.8272, std.dev.: 0.0472)
  MultiSource/Applications/SPASS/SPASS: -4.72% (8.5363 => 8.1337, std.dev.: 0.1044)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.63% (2.5559 => 2.4375, std.dev.: 0.0170)
  MultiSource/Applications/lemon/lemon: -3.41% (0.8632 => 0.8338, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.95% (6.0535 => 5.8750, std.dev.: 0.0105)
  MultiSource/Applications/minisat/minisat: -2.65% (6.3881 => 6.2191, std.dev.: 0.0550)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.12% (61.0792 => 59.7844, std.dev.: 0.4616)

Report Time: 0.87s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140110/62660e2f/attachment.html>


More information about the llvm-testresults mailing list