[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Jun 1 07:13:44 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11950?compare_to=11947&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11950, Order: 183073, Start Time: 2013-06-01 12:34:09, End Time: 2013-06-01 14:14:21
      To: 11947, Order: 183068, Start Time: 2013-06-01 10:29:03, End Time: 2013-06-01 12:14:10
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 10 (13 on baseline)
Performance Improvements: 7 (114 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1090 (980 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 20.48% (2.0239 => 2.4383, std.dev.: 0.0551)
  MultiSource/Benchmarks/nbench/nbench: 17.13% (19.5494 => 22.8983, std.dev.: 0.2163)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 8.16% (0.3001 => 0.3246, std.dev.: 0.0009)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.98% (0.4954 => 0.5151, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 3.71% (1.4546 => 1.5085, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.62% (3.6276 => 3.7590, std.dev.: 0.0103)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.51% (0.4244 => 0.4393, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.30% (2.5225 => 2.6058, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.41% (2.9698 => 3.0116, std.dev.: 0.0153)
  SingleSource/Benchmarks/Shootout/methcall: 1.06% (8.4974 => 8.5872, std.dev.: 0.0148)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/oggenc/oggenc: -1.59% (5.6837 => 5.5935, std.dev.: 0.0269)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.15% (1.5113 => 1.4939, std.dev.: 0.0043)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary: -14.84% (0.0748 => 0.0637, std.dev.: 0.0034)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.32% (1.2846 => 1.2420, std.dev.: 0.0039)
  MultiSource/Applications/lua/lua: -1.76% (28.7163 => 28.2108, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.46% (4.8112 => 4.7408, std.dev.: 0.0177)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.35% (21.9738 => 21.6782, std.dev.: 0.0925)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1421 => 0.1423, std.dev.: 0.0018)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.10% (0.2721 => 0.2887, std.dev.: 0.0018)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 33.11% (1.8318 => 2.4383, std.dev.: 0.0551)
  MultiSource/Applications/sgefa/sgefa: 17.81% (1.1695 => 1.3778, std.dev.: 0.0455)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.06% (3.6122 => 3.7590, std.dev.: 0.0103)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.27% (0.4988 => 0.5151, std.dev.: 0.0016)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.04% (2.5366 => 2.6137, std.dev.: 0.0267)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.96% (2.5309 => 2.6058, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout/methcall: 2.93% (8.3425 => 8.5872, std.dev.: 0.0148)
  MultiSource/Benchmarks/nbench/nbench: 2.68% (22.3004 => 22.8983, std.dev.: 0.2163)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (4.3727 => 4.4717, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.04% (1.4783 => 1.5085, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.56% (3.9713 => 4.0331, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.07% (9.8728 => 9.9789, std.dev.: 0.0067)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -35.31% (0.1113 => 0.0720, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/lowercase: -32.27% (0.0344 => 0.0233, std.dev.: 0.0036)
  MultiSource/Applications/viterbi/viterbi: -25.46% (0.2431 => 0.1812, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -17.43% (0.0803 => 0.0663, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/whetstone: -16.04% (0.1097 => 0.0921, std.dev.: 0.0004)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.33% (0.7918 => 0.6783, std.dev.: 0.0069)
  SingleSource/UnitTests/Vector/constpool: -13.99% (10.3086 => 8.8665, std.dev.: 0.1924)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.60% (0.1646 => 0.1455, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.29% (0.1151 => 0.1021, std.dev.: 0.0012)
  MultiSource/Applications/JM/lencod/lencod: -11.03% (18.9387 => 16.8501, std.dev.: 0.0080)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -10.88% (0.1075 => 0.0958, std.dev.: 0.0003)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -10.77% (1.0314 => 0.9203, std.dev.: 0.0093)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.67% (0.1322 => 0.1181, std.dev.: 0.0039)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.52% (0.2006 => 0.1795, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.51% (1.5932 => 1.4257, std.dev.: 0.0071)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -10.31% (51.0211 => 45.7603, std.dev.: 0.1461)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.19% (0.8025 => 0.7207, std.dev.: 0.0041)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -9.54% (0.1886 => 0.1706, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.31% (5.1587 => 4.6783, std.dev.: 0.0098)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.90% (1.7804 => 1.6220, std.dev.: 0.0023)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.87% (0.1861 => 0.1696, std.dev.: 0.0020)
  MultiSource/Applications/aha/aha: -8.03% (0.1407 => 0.1294, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -7.87% (5.4314 => 5.0040, std.dev.: 0.0152)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -7.49% (0.1563 => 0.1446, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.19% (0.7381 => 0.6850, std.dev.: 0.0062)
  MultiSource/Applications/Burg/burg: -6.73% (1.5375 => 1.4341, std.dev.: 0.0067)
  MultiSource/Benchmarks/McCat/09-vor/vor: -6.69% (0.3723 => 0.3474, std.dev.: 0.0016)
  MultiSource/Applications/oggenc/oggenc: -6.60% (5.9886 => 5.5935, std.dev.: 0.0269)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.53% (15.9860 => 14.9428, std.dev.: 0.0141)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.34% (1.6793 => 1.5728, std.dev.: 0.0014)
  MultiSource/Applications/lemon/lemon: -6.34% (1.3155 => 1.2321, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/strcat: -6.24% (0.2309 => 0.2165, std.dev.: 0.0006)
  MultiSource/Applications/kimwitu++/kc: -6.07% (20.1855 => 18.9608, std.dev.: 0.0245)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.96% (0.2416 => 0.2272, std.dev.: 0.0024)
  MultiSource/Benchmarks/McCat/18-imp/imp: -5.64% (0.4199 => 0.3962, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/objinst: -5.51% (0.2397 => 0.2265, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.37% (2.0439 => 1.9342, std.dev.: 0.0076)
  MultiSource/Applications/lambda-0_1_3/lambda: -5.06% (0.8649 => 0.8211, std.dev.: 0.0084)
  MultiSource/Benchmarks/McCat/05-eks/eks: -5.02% (0.5698 => 0.5412, std.dev.: 0.0027)
  MultiSource/Benchmarks/Olden/em3d/em3d: -5.01% (0.2117 => 0.2011, std.dev.: 0.0010)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.79% (0.2753 => 0.2621, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.75% (6.6236 => 6.3090, std.dev.: 0.0252)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -4.73% (1.3686 => 1.3038, std.dev.: 0.0077)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.69% (0.4030 => 0.3841, std.dev.: 0.0041)
  MultiSource/Applications/SPASS/SPASS: -4.54% (17.6379 => 16.8365, std.dev.: 0.0174)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -4.52% (0.5748 => 0.5488, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/ary2: -4.47% (0.2951 => 0.2819, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/hash: -4.02% (0.4554 => 0.4371, std.dev.: 0.0025)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.92% (0.2961 => 0.2845, std.dev.: 0.0015)
  SingleSource/Benchmarks/Linpack/linpack-pc: -3.91% (0.2738 => 0.2631, std.dev.: 0.0033)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.63% (7.7211 => 7.4408, std.dev.: 0.0106)
  MultiSource/Benchmarks/Olden/bh/bh: -3.59% (0.3429 => 0.3306, std.dev.: 0.0019)
  MultiSource/Applications/ClamAV/clamscan: -3.48% (17.3229 => 16.7193, std.dev.: 0.0357)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.38% (0.4293 => 0.4148, std.dev.: 0.0032)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.14% (0.5887 => 0.5702, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.10% (10.1602 => 9.8452, std.dev.: 0.0100)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.63% (0.4861 => 0.4733, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.60% (0.8969 => 0.8736, std.dev.: 0.0050)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.59% (1.2006 => 1.1695, std.dev.: 0.0077)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.48% (0.9957 => 0.9710, std.dev.: 0.0058)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.23% (1.1954 => 1.1687, std.dev.: 0.0082)
  MultiSource/Applications/minisat/minisat: -2.21% (0.7844 => 0.7671, std.dev.: 0.0007)
  MultiSource/Applications/sqlite3/sqlite3: -2.14% (16.9719 => 16.6091, std.dev.: 0.0588)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.13% (10.7257 => 10.4970, std.dev.: 0.0648)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.81% (25.9348 => 25.4661, std.dev.: 0.0637)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -1.56% (0.6788 => 0.6682, std.dev.: 0.0037)
  MultiSource/Applications/d/make_dparser: -1.45% (3.7330 => 3.6789, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C/football/football: -1.43% (1.0292 => 1.0145, std.dev.: 0.0030)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.21% (1.4253 => 1.4080, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.02% (1.4771 => 1.4620, std.dev.: 0.0020)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.47% (1.2911 => 0.7298, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/mst/mst: -36.59% (0.2099 => 0.1331, std.dev.: 0.0003)
  MultiSource/Applications/lemon/lemon: -34.40% (1.3499 => 0.8856, std.dev.: 0.0344)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.63% (4.4050 => 3.2321, std.dev.: 0.0037)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -25.69% (1.0251 => 0.7618, std.dev.: 0.0498)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -25.28% (6.2328 => 4.6570, std.dev.: 0.1879)
  SingleSource/Benchmarks/Misc/salsa20: -22.11% (10.3398 => 8.0535, std.dev.: 0.4444)
  MultiSource/Benchmarks/Olden/bisort/bisort: -21.68% (0.8606 => 0.6740, std.dev.: 0.0096)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -17.00% (1.8291 => 1.5181, std.dev.: 0.0615)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -16.52% (3.5000 => 2.9219, std.dev.: 0.1181)
  MultiSource/Benchmarks/mafft/pairlocalalign: -16.45% (48.3307 => 40.3810, std.dev.: 1.4648)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.06% (25.3677 => 21.2930, std.dev.: 0.0472)
  MultiSource/Applications/minisat/minisat: -15.64% (7.3703 => 6.2177, std.dev.: 0.0187)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -11.28% (10.2418 => 9.0866, std.dev.: 0.1205)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.56% (0.3702 => 0.3311, std.dev.: 0.0148)
  MultiSource/Applications/SPASS/SPASS: -9.46% (8.8720 => 8.0324, std.dev.: 0.1398)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.20% (3.5327 => 3.2077, std.dev.: 0.0024)
  MultiSource/Benchmarks/FreeBench/neural/neural: -7.26% (0.3513 => 0.3258, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.25% (3.2030 => 2.9707, std.dev.: 0.0344)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.95% (0.2777 => 0.2584, std.dev.: 0.0062)
  SingleSource/Benchmarks/Misc/flops: -6.65% (10.2170 => 9.5377, std.dev.: 0.1522)
  MultiSource/Applications/sqlite3/sqlite3: -5.74% (4.6358 => 4.3697, std.dev.: 0.0302)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.71% (39.1740 => 36.9354, std.dev.: 0.2913)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.60% (4.5717 => 4.3159, std.dev.: 0.0016)
  MultiSource/Benchmarks/FreeBench/distray/distray: -5.02% (0.2332 => 0.2215, std.dev.: 0.0037)
  MultiSource/Benchmarks/Bullet/bullet: -4.42% (7.1938 => 6.8760, std.dev.: 0.0255)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.84% (1.6613 => 1.5975, std.dev.: 0.0109)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.79% (9.1099 => 8.7649, std.dev.: 0.0349)
  MultiSource/Benchmarks/BitBench/five11/five11: -3.04% (5.7342 => 5.5601, std.dev.: 0.0640)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.84% (2.8537 => 2.7727, std.dev.: 0.0132)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.72% (3.8665 => 3.7613, std.dev.: 0.0065)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.69% (1.6679 => 1.6230, std.dev.: 0.0099)
  SingleSource/Benchmarks/Shootout/hash: -2.42% (5.3656 => 5.2355, std.dev.: 0.0340)
  MultiSource/Applications/obsequi/Obsequi: -2.17% (2.2398 => 2.1911, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.92% (4.2167 => 4.1358, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.87% (62.4345 => 61.2687, std.dev.: 0.2908)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.68% (2.8573 => 2.8093, std.dev.: 0.0046)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.34% (12.1841 => 12.0213, std.dev.: 0.0573)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.26% (1.2579 => 1.2420, std.dev.: 0.0039)
  MultiSource/Applications/viterbi/viterbi: -1.24% (2.5688 => 2.5370, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.14% (1.3084 => 1.2935, std.dev.: 0.0056)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -1.09% (1.6105 => 1.5930, std.dev.: 0.0016)
  MultiSource/Applications/aha/aha: -1.04% (3.6251 => 3.5874, std.dev.: 0.0076)
  MultiSource/Benchmarks/Olden/bh/bh: -1.00% (2.4435 => 2.4190, std.dev.: 0.0058)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.25% (0.1441 => 0.1423, std.dev.: 0.0018)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130601/db393ba7/attachment.html>


More information about the llvm-testresults mailing list