[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon May 27 12:48:14 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11779?compare_to=11776&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11779, Order: 182741, Start Time: 2013-05-27 18:08:04, End Time: 2013-05-27 19:48:46
      To: 11776, Order: 182738, Start Time: 2013-05-27 16:04:33, End Time: 2013-05-27 17:48:09
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 6 (7 on baseline)
Performance Improvements: 7 (117 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1094 (983 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.70% (0.6671 => 0.6851, std.dev.: 0.0046)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.19% (0.8723 => 0.8827, std.dev.: 0.0034)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: 12.82% (6.9482 => 7.8389, std.dev.: 0.1083)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.46% (0.1126 => 0.1255, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/flops-4: 4.90% (1.5402 => 1.6156, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.46% (4.7452 => 4.9093, std.dev.: 0.0080)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.67% (0.3298 => 0.3144, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.23% (2.6762 => 2.6166, std.dev.: 0.0132)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.84% (0.6406 => 0.6288, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (6.7208 => 6.6349, std.dev.: 0.0221)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.89% (4.6839 => 4.5485, std.dev.: 0.0141)
  SingleSource/Benchmarks/Misc/richards_benchmark: -1.33% (1.3593 => 1.3412, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/flops-6: -1.19% (2.4576 => 2.4283, std.dev.: 0.0028)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.06% (0.1454 => 0.1424, std.dev.: 0.0002)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 23.80% (1.8318 => 2.2677, std.dev.: 0.1337)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.46% (0.9806 => 1.0930, std.dev.: 0.0002)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.07% (1.2224 => 1.2844, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout/methcall: 3.00% (8.3425 => 8.5925, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.56% (3.9713 => 4.0730, std.dev.: 0.0077)
  MultiSource/Applications/spiff/spiff: 1.57% (2.8536 => 2.8984, std.dev.: 0.0101)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 1.29% (88.2998 => 89.4414, std.dev.: 0.0525)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -26.41% (0.2431 => 0.1789, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -17.19% (0.0803 => 0.0665, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/whetstone: -16.41% (0.1097 => 0.0917, std.dev.: 0.0011)
  SingleSource/UnitTests/Vector/constpool: -14.43% (10.3086 => 8.8208, std.dev.: 0.2168)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -12.58% (0.7918 => 0.6922, std.dev.: 0.0090)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.73% (0.1151 => 0.1016, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.17% (0.2006 => 0.1782, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -11.07% (0.1075 => 0.0956, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.06% (0.1646 => 0.1464, std.dev.: 0.0004)
  MultiSource/Applications/JM/lencod/lencod: -11.03% (18.9387 => 16.8493, std.dev.: 0.0535)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -10.88% (1.0314 => 0.9192, std.dev.: 0.0220)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.51% (0.1322 => 0.1183, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.39% (1.5932 => 1.4277, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.01% (5.1587 => 4.6425, std.dev.: 0.0316)
  MultiSource/Applications/aha/aha: -9.81% (0.1407 => 0.1269, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.79% (0.8025 => 0.7239, std.dev.: 0.0113)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.82% (5.4314 => 4.9526, std.dev.: 0.0364)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (0.1224 => 0.1121, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.40% (1.7804 => 1.6309, std.dev.: 0.0022)
  MultiSource/Applications/Burg/burg: -7.58% (1.5375 => 1.4210, std.dev.: 0.0102)
  MultiSource/Applications/lemon/lemon: -7.40% (1.3155 => 1.2182, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -7.21% (0.1886 => 0.1750, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.94% (15.9860 => 14.8762, std.dev.: 0.0561)
  MultiSource/Applications/oggenc/oggenc: -6.59% (5.9886 => 5.5939, std.dev.: 0.0039)
  MultiSource/Benchmarks/McCat/18-imp/imp: -6.36% (0.4199 => 0.3932, std.dev.: 0.0019)
  MultiSource/Benchmarks/Olden/em3d/em3d: -6.14% (0.2117 => 0.1987, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.14% (0.7381 => 0.6928, std.dev.: 0.0034)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.99% (0.2753 => 0.2588, std.dev.: 0.0012)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.87% (1.6793 => 1.5808, std.dev.: 0.0025)
  MultiSource/Applications/kimwitu++/kc: -5.72% (20.1855 => 19.0318, std.dev.: 0.0476)
  MultiSource/Benchmarks/McCat/05-eks/eks: -5.70% (0.5698 => 0.5373, std.dev.: 0.0012)
  MultiSource/Benchmarks/McCat/09-vor/vor: -5.61% (0.3723 => 0.3514, std.dev.: 0.0016)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.52% (2.0439 => 1.9311, std.dev.: 0.0045)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -5.52% (51.0211 => 48.2054, std.dev.: 0.1319)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -5.44% (1.3686 => 1.2941, std.dev.: 0.0075)
  SingleSource/Benchmarks/Shootout-C++/objinst: -5.13% (0.2397 => 0.2274, std.dev.: 0.0018)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.10% (0.2961 => 0.2810, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.01% (0.4030 => 0.3828, std.dev.: 0.0038)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.86% (0.8649 => 0.8229, std.dev.: 0.0074)
  SingleSource/Benchmarks/Shootout-C++/strcat: -4.85% (0.2309 => 0.2197, std.dev.: 0.0006)
  MultiSource/Applications/SPASS/SPASS: -4.70% (17.6379 => 16.8092, std.dev.: 0.0026)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.65% (0.3853 => 0.3674, std.dev.: 0.0008)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.51% (0.2415 => 0.2306, std.dev.: 0.0039)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -4.37% (0.5748 => 0.5497, std.dev.: 0.0013)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.28% (7.7211 => 7.3903, std.dev.: 0.0526)
  SingleSource/Benchmarks/Linpack/linpack-pc: -4.24% (0.2738 => 0.2622, std.dev.: 0.0015)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.02% (10.1602 => 9.7521, std.dev.: 0.0629)
  MultiSource/Benchmarks/Olden/bh/bh: -3.94% (0.3429 => 0.3294, std.dev.: 0.0020)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.76% (0.4861 => 0.4678, std.dev.: 0.0024)
  MultiSource/Benchmarks/McCat/08-main/main: -3.36% (0.3040 => 0.2938, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/hash: -3.29% (0.4554 => 0.4404, std.dev.: 0.0019)
  MultiSource/Applications/ClamAV/clamscan: -3.01% (17.3229 => 16.8007, std.dev.: 0.0152)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.94% (0.5887 => 0.5714, std.dev.: 0.0039)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.62% (0.7334 => 0.7142, std.dev.: 0.0065)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.61% (10.7257 => 10.4453, std.dev.: 0.0197)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.58% (0.9957 => 0.9700, std.dev.: 0.0009)
  MultiSource/Applications/sqlite3/sqlite3: -2.27% (16.9719 => 16.5860, std.dev.: 0.0234)
  MultiSource/Applications/minisat/minisat: -1.61% (0.7844 => 0.7718, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.58% (0.8969 => 0.8827, std.dev.: 0.0034)
  MultiSource/Applications/d/make_dparser: -1.56% (3.7330 => 3.6747, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.45% (1.8435 => 1.8167, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.17% (1.4771 => 1.4598, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.17% (1.6804 => 1.6608, std.dev.: 0.0037)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.16% (1.4253 => 1.4088, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.09% (1.6275 => 1.6098, std.dev.: 0.0016)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -51.85% (0.0243 => 0.0117, std.dev.: 0.0049)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.54% (1.2911 => 0.7290, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/mst/mst: -37.30% (0.2099 => 0.1316, std.dev.: 0.0011)
  MultiSource/Applications/lemon/lemon: -33.20% (1.3499 => 0.9017, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.46% (4.4050 => 3.2393, std.dev.: 0.1402)
  SingleSource/Benchmarks/Misc/salsa20: -22.96% (10.3398 => 7.9656, std.dev.: 0.4860)
  MultiSource/Benchmarks/Olden/bisort/bisort: -21.76% (0.8606 => 0.6733, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.29% (6.2328 => 5.0303, std.dev.: 0.0115)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -17.69% (1.8291 => 1.5056, std.dev.: 0.0604)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -17.03% (0.0599 => 0.0497, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -16.68% (3.5000 => 2.9162, std.dev.: 0.0153)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.22% (25.3677 => 21.2530, std.dev.: 0.0729)
  MultiSource/Applications/minisat/minisat: -15.26% (7.3703 => 6.2454, std.dev.: 0.0496)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -14.66% (1.0251 => 0.8748, std.dev.: 0.0088)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -12.12% (0.1007 => 0.0885, std.dev.: 0.0032)
  MultiSource/Applications/SIBsim4/SIBsim4: -12.05% (3.5327 => 3.1070, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -11.71% (3.5120 => 3.1009, std.dev.: 0.1353)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -11.38% (10.2418 => 9.0764, std.dev.: 0.1745)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.62% (0.3702 => 0.3309, std.dev.: 0.0113)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.14% (0.7941 => 0.7215, std.dev.: 0.0024)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.06% (32.4581 => 29.5162, std.dev.: 0.1081)
  MultiSource/Applications/SPASS/SPASS: -8.39% (8.8720 => 8.1272, std.dev.: 0.1057)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.03% (48.3307 => 44.4521, std.dev.: 0.1004)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.27% (3.2030 => 2.9701, std.dev.: 0.0274)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.89% (0.1945 => 0.1811, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/flops: -6.64% (10.2170 => 9.5383, std.dev.: 0.1504)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -6.39% (2.4808 => 2.3223, std.dev.: 0.0564)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.67% (39.1740 => 36.9519, std.dev.: 0.5378)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.59% (4.5717 => 4.3160, std.dev.: 0.0004)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.39% (2.5366 => 2.4000, std.dev.: 0.0343)
  MultiSource/Benchmarks/FreeBench/neural/neural: -5.35% (0.3513 => 0.3325, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.83% (0.2777 => 0.2643, std.dev.: 0.0017)
  MultiSource/Benchmarks/FreeBench/distray/distray: -4.80% (0.2332 => 0.2220, std.dev.: 0.0039)
  MultiSource/Applications/sqlite3/sqlite3: -3.75% (4.6358 => 4.4618, std.dev.: 0.0084)
  SingleSource/Benchmarks/Shootout/ary3: -3.66% (6.0122 => 5.7924, std.dev.: 0.0226)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.53% (1.6613 => 1.6026, std.dev.: 0.0019)
  MultiSource/Applications/JM/lencod/lencod: -3.17% (7.0353 => 6.8122, std.dev.: 0.0060)
  MultiSource/Benchmarks/BitBench/five11/five11: -3.02% (5.7342 => 5.5608, std.dev.: 0.0324)
  MultiSource/Benchmarks/Bullet/bullet: -2.87% (7.1938 => 6.9875, std.dev.: 0.0136)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.77% (1.6679 => 1.6217, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout/hash: -2.59% (5.3656 => 5.2265, std.dev.: 0.0144)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.40% (2.8537 => 2.7853, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.08% (4.6452 => 4.5485, std.dev.: 0.0141)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.81% (94.2966 => 92.5890, std.dev.: 0.0826)
  MultiSource/Applications/obsequi/Obsequi: -1.75% (2.2398 => 2.2005, std.dev.: 0.0054)
  MultiSource/Applications/aha/aha: -1.61% (3.6251 => 3.5666, std.dev.: 0.0078)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.59% (1.1291 => 1.1112, std.dev.: 0.0022)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.40% (12.1841 => 12.0134, std.dev.: 0.0032)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.35% (2.8573 => 2.8186, std.dev.: 0.0012)
  MultiSource/Applications/viterbi/viterbi: -1.11% (2.5688 => 2.5402, std.dev.: 0.0030)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -1.09% (1.6105 => 1.5930, std.dev.: 0.0042)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.09% (2.5408 => 2.5132, std.dev.: 0.0004)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.18% (0.1441 => 0.1424, std.dev.: 0.0002)

Report Time: 0.97s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130527/43520c2a/attachment.html>


More information about the llvm-testresults mailing list